Figure 1. Percent of titles/abstracts requiring resolution over time
The Agency for Healthcare Research and Quality (AHRQ), through its Evidence-based Practice Centers (EPCs), sponsors the development of evidence reports and technology assessments to assist public- and private-sector organizations in their efforts to improve the quality of health care in the United States. The reports and assessments provide organizations with comprehensive, science-based information on common, costly medical conditions and new health care technologies. The EPCs systematically review the relevant scientific literature on topics assigned to them by AHRQ and conduct additional analyses when appropriate prior to developing their reports and assessments.
To bring the broadest range of experts into the development of evidence reports and health technology assessments, AHRQ encourages the EPCs to form partnerships and enter into collaborations with other medical and research organizations. The EPCs work with these partner organizations to ensure that the evidence reports and technology assessments they produce will become building blocks for health care quality improvement projects throughout the Nation. The reports undergo peer review prior to their release.
AHRQ expects that the EPC evidence reports and technology assessments will inform individual health plans, providers, and purchasers as well as the health care system as a whole by providing important information to help improve health care quality.
We welcome written comments on this evidence report. They may be sent to: Director, Center for Practice and Technology Assessment, Agency for Healthcare Research and Quality, 6010 Executive Blvd., Suite 300, Rockville, MD 20852.
| John M. Eisenberg, M.D. | Douglas B. Kamerow, M.D. |
| Director | Director, Center for Practice and |
| Agency for Healthcare Research and Quality | Technology Assessment |
| Agency for Healthcare Research and Quality |
| The authors of this report are responsible for its content. Statements in the report should not be construed as endorsement by the Agency for Healthcare Research and Quality or the U.S. Department of Health and Human Services of a particular drug, device, test, treatment, or other clinical service. |
Our objective with this report was to analyze the evidence on the initial management of uncomplicated acute otitis media (AOM) in children. We assessed three questions: What is the natural history of AOM without antibiotic treatment? Are antibiotics effective in preventing clinical failure? and What is the relative effectiveness of specific antibiotic regimens such as: (1) amoxicillin or trimethoprim-sulfamethoxazole vs. other antibiotics, (2) oral fluoroquinolones, (3) >60 mg/kg/day amoxicillin or amoxicillin-clavulanate vs. 40 mg/kg/day, (4) high-dose amoxicillin therapy twice a day vs. three times a day, and (5) short-term vs. long-term antibiotic therapy?
The technical experts and project staff developed a literature search strategy that used MEDLINE, the Cochrane Library, HealthSTAR, International Pharmaceutical Abstracts, Cumulative Index to Nursing & Allied Health Literature, BIOSIS, and EMBASE. Headings included "om" (otitis media), "mastoiditis," "om w/effusion," "om, suppurative" with the subheading "drug therapy," and "anti-infective agents," including "antibiotics" and "other drugs." Text words included otitis media, antibiotic, antimicrobial, antibacterial, specific antibiotic names and natural history, natural course, untreated, spontaneous, and self-limited for the natural history search. Additional articles were identified by review of reference lists in proceedings, published articles, reports, and guidelines.
The selection criteria included human studies addressing AOM in children age 4 weeks to 18 years. Excluded were studies on patients with immunodeficiencies or craniofacial deficiencies, including cleft palate. Randomized clinical trials and cohort studies were included for the question on natural history. Randomized controlled trials were used to address the questions on antibiotic effectiveness.
Two physician reviewers independently evaluated articles and abstracted data. They excluded articles that did not address any of the key questions or that had unabstractable data. They assessed the quality of the studies. Project staff developed evidence tables using the abstracted data. Meta-analyses were performed as appropriate. Twenty-four experts and consumers critiqued the draft of this evidence report.
Clinical failure was defined generally as the failure to resolve or improve clinical signs and symptoms at specific time intervals. In children with AOM not initially treated with antibiotics, the reported rate of clinical failure at 24-48 hours was 7.7 percent in one study and at 24-72 hours was 26 percent in another study. The pooled estimated failure rate at 1-7 days was 18.9 percent and was 22.2 percent at 4-7 days. Compared with this failure rate, children treated with ampicillin or amoxicillin showed a reduction in clinical failure at 2-7 days of 12.3 percent. This result generally was robust to sensitivity analysis. Eight children with AOM would need to be treated with ampicillin or amoxicillin rather than no antibiotic treatment to avoid a case failure. The pooled comparisons of specific antibiotic regimens showed no difference in clinical failure rates. Adverse effects, primarily gastrointestinal, were more common in children on cefixime than those on ampicillin or amoxicillin and more common in children on amoxicillin-clavulanate (original formulation) than those on azithromycin.
There is a wide range of reported clinical failure rates in the first week in children with AOM who are not treated with antibiotics. The pooled estimates indicate that a majority of these children have clinical resolution within the first week after presentation. These studies, which generally are of small sample size, report few episodes of suppurative complications, regardless of antibiotic treatment. In general, the children in the natural history studies had close followup. Antibiotic treatment with ampicillin or amoxicillin produces a statistically significant improvement in failure rates compared with no antibiotic treatment of AOM. We found no difference in clinical failure rates in the antibiotic regimens assessed. Since we were unable to do subgroup analysis in the meta-analytic comparisons, we cannot generalize those findings to children in specific age groups, such as younger than or older than 2 years of age, or by otitis-prone status. Several studies suggest greater caution be taken with children younger than 2 years old.
Randomized controlled studies still are needed to address definitively the initial key questions. Future research should focus on: (1) establishing uniform definitions of AOM and relevant outcomes, (2) establishing uniform diagnostic criteria, (3) strengthening internal and external validity, (4) addressing relevant influencing factors such as age and otitis-prone state, and (5) measuring long-term as well as short-term outcomes. Studies also should be of sufficient power to establish differences in antibiotic efficacy. In addition, future studies should address the bacterial resistance issue.
This document is in the public domain and may be used and reprinted without permission except those copyrighted materials noted for which further reproduction is prohibited without the specific permission of copyright holders.
Marcy M, Takata G, Shekelle P, et al. Management of Acute Otitis Media. Evidence Report/Technology Assessment No. 15 (Prepared by the Southern California Evidence-based Practice Center under Contract No. 290-97-0001). AHRQ Publication No. 01-E010. Rockville, MD: Agency for Healthcare Research and Quality. May 2001.
The objective of this report was to analyze the evidence on the initial management of uncomplicated acute otitis media (AOM) in children. AOM is one of the most common diagnoses in children. Data from the National Ambulatory Medical Care Surveys (NAMCS), which did not differentiate between AOM and otitis media with effusion, indicated that the number of office visits for AOM increased more than two-fold from 1975 to 1990. Gates (1996a) believed that the majority of these cases represented AOM. Based on national data from NAMCS and the National Hospital Ambulatory Medical Care Surveys, and several assumptions detailed in Appendix A, we estimated that 5.18 million episodes of AOM occurred in 1995 at a cost of approximately $2.98 billion, including direct and indirect costs and the costs of sequelae such as otitis media with effusion and chronic middle ear infection. These estimates suggest that increased effectiveness in treating AOM could achieve significant national cost savings.
AOM was defined by the Technical Expert Panel as the presence of middle ear effusion in conjunction with the rapid onset of one or more signs or symptoms of inflammation of the middle ear. Uncomplicated AOM was defined as AOM that is limited to the middle ear cleft. An episode of uncomplicated AOM was considered distinct from a previous episode of AOM and was eligible for initial treatment if the most recent course of antibiotics ended 4 weeks prior to the episode of AOM in question, or if there was documentation by an examiner that a prior episode of AOM had been cleared.
Various medical and surgical treatments have been used for AOM. There is controversy about the need for antibiotics, particularly in children older than 6 months of age with uncomplicated AOM. It is routine to use antibiotics for AOM in the United States, whereas in the Netherlands the standard practice is to observe selected children older than 2 years of age for 48 hours and selected children age 6 months to 2 years for 24 hours before initiating antibiotics. Antibiotics are prescribed if clinical resolution does not occur during the observation period. The presence of alternative treatment paradigms of questioned effectiveness suggests that an evidence-based analysis on the management of AOM is needed to determine the efficacy of antibiotic therapy.
The Technical Expert Panel limited the scope of this evidence report to three key clinical questions:
What is the natural history of AOM without antibiotic treatment?
Are antibiotics effective in preventing clinical failure?
What is the relative effectiveness of specific antibiotic regimens?
The regimens we analyzed were:
(1) amoxicillin or trimethoprim-sulfamethoxazole vs. other antibiotics,
(2) oral fluoroquinolones,
(3) 60 mg or higher per kg/day of amoxicillin or amoxicillin-clavulanate vs. the standard 40 mg per kg/day,
(4) high-dose amoxicillin therapy twice a day vs. three times a day, and
(5) short-term vs. long-term antibiotic therapy.
The Technical Expert Panel decided that this systematic review would focus on children ages 4 weeks to 18 years, who had uncomplicated AOM and were seeking initial treatment. The major outcomes included presence or absence of signs and symptoms within 48 hours, at 3 to 7 days, 7 to14 days, 14 days to 3 months, and after 3 months; presence or absence of adverse effects from antibiotic treatment; and presence or absence of bacteria and/or resistant bacteria.
Of a total of 41 factors that the Technical Expert Panel felt could influence outcomes apart from antibiotics, the panel ranked age (younger and older than 2 years) and otitis-prone state as the two most important factors. The otitis-prone child was defined as the child who had three or more episodes of AOM in a 6-month period or four or more episodes of AOM in a 12-month period.
An 11-member Technical Expert Panel consisting of clinical experts, a consumer, and a representative of a managed care organization convened to:
advise the project in the ranking of proposed key questions and influencing factors,
guide the development of the scope and definition of AOM,
advise in development of the search strategy, and
review and comment on the analysis plan.
The Technical Expert Panel and project staff developed a literature search strategy. The initial strategy was developed for MEDLINE and was customized for other databases. Project staff searched MEDLINE (1966-March 1999), the Cochrane Library (through march 1999), HealthSTAR (1975-March 1999), International Pharmaceutical Abstracts (1970-March 1999), the Cumulative Index to Nursing & Allied Health Literature (1982-March 1999), BIOSIS (1970-March 1999), and EMBASE (1980-March 1999). Additional articles were identified by review of reference lists in proceedings, published articles, reports, and guidelines.
The initial module of search statements included an explode of "om" (otitis media), which included the headings "om, mastoiditis," "om w/effusion," and "om, suppurative" with the subheading "drug therapy." The next module included the explode of "om," with "om" as a text word. The anti-infectives module used an explode of the mesh heading for anti-infective agents, including antibiotics and other drug groups, and the text words antibiotic, antimicrobial, antibacterial, and specific antibiotic names. Combinations of these modules were used for the literature search. The search was limited to human or undesignated studies and to infant, child, preschool, adolescence, or undesignated subjects. For the natural history search, natural history, natural course, untreated, spontaneous, and self-limited were added as keywords. Two physicians independently screened all titles and/or abstracts for potential inclusion, evaluated the quality of the articles, and abstracted data from full-length articles onto predesigned forms. The selection criteria included human studies that addressed a key question about AOM in children ages 4 weeks to 18 years. Excluded were case reports, editorials, letters, reviews, practice guidelines, and studies on patients with immunodeficiencies or craniofacial deficiencies, including cleft palate. Randomized clinical trials and prospective and retrospective comparative cohort studies were included for the key question on natural history. Only randomized controlled trials were used to address the key questions on the effectiveness of antibiotics. The physician reviewers assessed the quality of controlled trials by using an established tool that focused on randomization, blinding, and reporting of subject withdrawals. They also noted approximation to the diagnostic criteria for AOM established by the Technical Expert Panel.
A physician reviewer also reviewed articles in 13 non-English languages with the assistance of a translator. An initial review of 97 non-English-language articles yielded only two eligible studies, both of which already were known to the project staff. Based on this outcome, the Technical Expert Panel advised the project staff to discontinue further screening of non-English-language citations. Based on peer reviewers' suggestions, the remaining five Dutch and Scandinavian articles were reviewed and no additional studies were found.
Meta-analyses were performed to determine the effectiveness of antibiotic vs. placebo or observational treatment of uncomplicated AOM and to determine the effectiveness of particular antibiotic regimens. Comparisons were established based on the type of antibiotics and the outcome variable under consideration. The technical experts decided to establish comparison groups by individual antibiotic, as this best fit the information required for clinical practice. A meta-analysis was performed for each comparison with three or more randomized controlled studies. Heterogeneity was measured for all meta-analyses, and a random effects model was used to estimate the absolute rate differences. Although subgroup and sensitivity analyses were initially planned based on age of the subject, otitis-prone status of the subject, study-design quality, and approximation to the Technical Expert Panel's diagnostic criteria for AOM, they could not be performed because an insufficient number of studies addressed these factors or because there was an insufficient number of studies within a comparison group.
This evidence report was critiqued by the Technical Expert Panel as well as a 25-member peer-review panel consisting of content experts, consumers, representatives of managed care organizations, an expert in pediatric pharmacology, and methodologists. All comments received from these individuals were reviewed and acted upon as appropriate.
In children with AOM who were not initial treated with antibiotics, one study showed a clinical failure rate of 7.7 percent at 24 to 48 hours, and another study showed a failure rate of 26 percent at 24 to 72 hours -- that is, clinical resolution was 92.3 percent at 24 to 48 hours and 74 percent at 24 to 72 hours. The pooled estimate of failure at 1 to 7 days was 18.9 percent (95 percent confidence intervals, 9.9 percent and 28.0 percent) and at 4 to 7 days was 22.2 percent (95 percent confidence intervals, 10.1 percent and 34.3 percent).
A previous information synthesis estimated that 59 percent (95 percent confidence intervals, 53 percent and 65 percent) of children not treated with antibiotics had resolution of pain and fever within 24 hours of diagnosis of AOM, 87 percent (95 percent confidence intervals, 84 percent and 89 percent) of children had resolution of pain and fever within 2 to 3 days, and 88 percent (95 percent confidence intervals, 85 percent and 91 percent) of children had resolution of pain and fever within 4 to 7 days.
The available evidence on natural history of AOM shows that in studies with close followup, few episodes of mastoiditis or other suppurative complications are reported in children with AOM who are not treated initially with antibiotics.
Meta-analysis demonstrated a reduction in the clinical failure rate within 2 to 7 days of 12.3 percent (95 percent confidence intervals, 2.8 percent and 21.8 percent) in favor of ampicillin or amoxicillin therapy compared with placebo or observational treatment. This result was generally robust to sensitivity analysis. Eight children with AOM would need to be treated with ampicillin or amoxicillin rather than no antibiotic treatment to avoid a case of clinical failure.
Previous meta-analyses have demonstrated minimal to modest benefits of antibiotics compared with observational intervention without antibiotics during the initial treatment of AOM for the following outcomes: pain and fever resolution at 2 days, pain resolution at 2 to 7 days, contralateral otitis media and 7- to14-day clinical resolution rate. The following outcomes did not appear to be affected by antibiotic use: pain resolution at 24 hours, pain and fever resolution at 4 to 7 days, tympanic membrane perforation, vomiting/diarrhea/rash, 1-month tympanometry, or recurrent AOM.
Meta-analyses did not demonstrate a significant rate difference in clinical failure rates in children with AOM treated with ampicillin or amoxicillin compared with children treated with penicillin, cefaclor, or cefixime.
Meta-analysis did not demonstrate a significant difference in clinical failure rates in children treated with trimethoprim-sulfamethoxazole compared with children treated with cefaclor for AOM.
Meta-analysis demonstrated that children treated with cefixime had an 8.4 percent greater rate of diarrhea than children treated with ampicillin or amoxicillin. Twelve children with AOM would need to be treated with ampicillin or amoxicillin rather than cefixime to avoid a case of diarrhea.
No comment can be made on the effect of oral fluoroquinolones compared with other antibiotics because no comparative, randomized controlled trials were found that addressed this question.
Although not establishing equivalency of effect, a single study demonstrated no difference in clinical effect of high-dose amoxicillin-clavulanate vs. standard-dose amoxicillin-clavulanate.
Although not establishing equivalency of effect, a single study did not demonstrate a difference in clinical effect of taking high-dose amoxicillin two times a day vs. three times a day.
Meta-analysis did not demonstrate a difference in clinical effect between short-duration therapy and long-duration therapy when comparing single-dose ceftriaxone therapy with 7 to 10 day amoxicillin therapy and azithromycin therapy for less than 5 days with 7 to 10 day amoxicillin-clavulanate therapy.
A previous meta-analysis demonstrated that short-acting oral antibiotic therapy of less than 2 days was not as effective as therapy lasting 7 days or longer.
Meta-analysis demonstrated that children treated with 7 to 10 day amoxicillin-clavulanate had a 19.2 percent (95 percent confidence intervals, 9.2 percent and 29.2 percent) greater rate of overall adverse effects and a 12.9 percent (95 percent confidence intervals, 4.5 percent and 21.2 percent) greater rate of gastrointestinal adverse effects than children treated with 5-day azithromycin. Eight children would need to be treated with azithromycin rather than amoxicillin-clavulanate to avoid a gastrointestinal adverse event. (Although not reported in the studies, the clavulanate concentration was most likely 31.25 mg per 125 mg of amoxicillin, i.e., original formulation.)
The diagnostic criteria for AOM were not uniform across studies.
Although some studies were of high quality, about one-half of the studies were not of adequate quality.
The AOM outcomes varied among studies, and the definition of common outcomes such as clinical failure were not uniform. This inconsistency made it difficult to compare results across studies.
The power of the studies to detect a difference appeared to be insufficient in most cases, although this was less important because the treatment effect sizes were generally less than 10 percent.
Although many studies had significant numbers of children younger and older than age 2 years, we could not do subgroup analysis because most of the studies did not report outcome by age. We were, therefore, unable to focus the findings of this study to children in specific age groups. Several studies suggest that greater caution should be taken with children younger than age 2 years; however, these studies do not answer this question definitively.
Because most of the studies did not report outcomes by otitis-prone status, we were unable to do subgroup analysis by this influencing factor.
Based on the exclusion factors of the investigations used in this analysis, the study findings are most applicable to children without comorbidities and with AOM of lesser severity.
Randomized controlled studies of high internal validity and adequate generalizability are needed to adequately address the key clinical questions asked at the start of this systematic review, including the question of the role of antibiotics in the treatment of uncomplicated AOM. Placebo-controlled trials of adequate power with sufficient patient variation for subgroup analysis are needed. Close monitoring of patients in these studies with a priori plans for appropriate intervention should allay any concerns about suppurative complications and should be a focus of research. Future research should: (1) establish uniform definitions of AOM and relevant clinical, bacteriologic, and societal outcomes; (2) establish uniform diagnostic criteria for AOM; (3) strengthen internal and external validity; (4) address relevant influencing factors, such as age and otitis-prone state, and (5) measure long-term as well as short-term outcomes. Uniform definition and diagnostic criteria are needed to ensure that results across studies can be compared. Appropriate randomization and blinding methods would establish the internal validity of future research. Sufficient variation in future study populations in terms of influencing factors as well as sufficient number of cases may allow results to be applied more readily to specific patients or populations and to be generalized to other populations. Although not addressed in this evidence-based analysis, future research should consider the impact of bacterial resistance on AOM outcomes. Investigators should prioritize AOM outcomes based, in large part, on their importance to patients, their families, and society as a whole because they bear the burden of AOM.
The purpose of this evidence-based report is to review the evidence on the natural history of acute otitis media (AOM) and the role of antibiotics in the treatment of uncomplicated AOM in children. The evidence compiled in this report is intended to aid the nominating organizations and others to develop clinical practice guidelines or medical review criteria for AOM. The report also will identify areas for future research.
The nominating organizations to this topic of the evidence report initially proposed five broad areas of inquiry: (1) factors influencing the course of an episode of AOM, (2) variation in definitions of AOM used in studies, (3) the role of antibiotics, (4) followup, and (5) prevention. Based on degree of importance, including level of controversy and feasibility of answering the question, the Technical Expert Panel limited the scope of this evidence report to the natural history of AOM and the role of antibiotics in treatment of children ages 4 weeks to 18 years. The study also evaluated the influence of specific factors apart from antibiotics on the course of AOM.
Although readily recognized as a clinical condition, AOM appears to be without a standard definition. In 1985, Paparella, Bluestone, Arnold, et al. (1985), reporting on an international effort to define terms related to otitis media, stated "The panel recognizes the impossibility of recommending terms unanimously acceptable to all." The following four sets of references are often cited as sources for authoritative definitions of AOM and demonstrate the lack of uniform specificity:
Although not defining acute otitis media, Paparella, Bluestone, Arnold, et al. (1985) defined otitis media as "an inflammation of the middle ear (which may or may not be of infectious origin in contrast to infection, which implies a microbiologic etiology)." An earlier attempt by the same group (Senturia, Paparella, Lowery, et al., 1980) had resulted in 8 categories of otitis media out of 28 that were modified by the term "acute." The group defined "acute process" as the "initial 3 weeks" associated with "onset -- may be short and rapid or signs and symptoms may be subtle and onset slow and insidious."
In 1992, the Infectious Diseases Society of America (Chow, Hall, Klein, et al., 1992) offered the following definition of AOM: "inflammation of the middle ear as evidenced by the presence of fluid and accompanied by specific signs or symptoms such as ear pain, ear drainage, hearing loss, or nonspecific findings such as fever, lethargy, irritability, anorexia, vomiting, or diarrhea." Diagnostic criteria were embedded in a definition that emphasized middle ear inflammation.
The Agency for Health Care Policy and Research Otitis Media with Effusion in Young Children. Clinical Practice Guideline (Stool, Berg, Berman, et al., 1994a) mentioned two definitions of AOM within the text of their work: "inflammation of the middle ear with signs or symptoms of middle ear infection" and "fluid in the middle ear accompanied by signs or symptoms of ear infection." One emphasized middle ear inflammation, the other middle ear infection.
Bluestone and Klein (1996), in a standard text of pediatric otolaryngology, provided two definitions of AOM: "the rapid onset of signs and symptoms of acute infection within the middle ear" and "the rapid and short onset of signs and symptoms of inflammation in the middle ear." The first definition emphasized middle ear infection, the second middle ear inflammation.
In 1985, Paparella, Bluestone, Arnold, et al. (1985) concluded, "It is not the panel's purpose to force usages, but rather to suggest terms to improve clinical and scientific communication. It is appropriate and right and, therefore, incumbent upon every author or speaker to define his/her own terms when communicating with colleagues." For the purpose of systematic review for this evidence-based analysis, a consensus was required among the technical experts on the definition of AOM to evaluate the studies retrieved for analysis of the key questions. A definition would aid in understanding the condition and would describe in codified terms characteristics of the condition that make it unique from other conditions, alluding to etiology and pathophysiology. A well-structured definition also would provide a framework to develop diagnostic criteria to diagnose the presence of AOM in individual patients. This process is detailed in the Methodology section.
Accurate estimates on the prevalence or incidence of AOM were not found because published population-based estimates are not available on the specific diagnosis of AOM. Data reported from the National Ambulatory Medical Care Survey (NAMCS) provided the best indication of prevalence and incidence of the disease, although nonsuppurative, suppurative, and unspecified otitis media were grouped into the term otitis media, and AOM and OME were not separated in the analyses (Schappert, 1992; Schappert, 1996; Woodwell, 1997a; Woodwell, 1997b; Woodwell and Schappert, 1995). Gates (1996a), commenting on the NAMCS data, stated, "For children, it is probably safe to presume that AOME (AOM with effusion) is the principal disorder noted in these surveys."
Schappert (1992) reported on the 1975-90 NAMCS data. Office visits by patients younger than 15 years of age with the principal diagnosis of otitis media constituted 70.6 percent in 1975; 78.9 percent in 1980; 81.9 in 1985; and 80.5 percent in 1990. From 1975 to 1990, the percentage of office visits with otitis media as the principal diagnosis increased in patients younger than age 15: from 7.3 to 17.4 percent for children younger than age 2; from 10.4 to 18.1 percent for ages 2 to 5; from 6.9 to 10.5 percent for ages 6 to 10; and from 2.6 to 5.2 percent for ages 11 to 14. The number of visits with a principal diagnosis of otitis media per 100 persons per year for the same time period (1975-90) increased from 31.5 to 102.1 for children younger than 2 years of age, 20.8 to 47.8 for those 2 to 5 years of age, 10.2 to 18.2 for those 6 to 10 years of age, and 3.3 to 8.0 for those 11 to 14 years of age.
From 1975 to 1990, the percentage of office visits with a principal diagnosis of otitis media increased from 8.1 to 14.3 percent for pediatricians, from 1.3 to 3.5 percent for general practitioners and family physicians, and 12.8 to 20.2 percent for otolaryngologists. The proportion of office visits for otitis media was higher for pediatricians compared with general practitioners and family physicians or otolaryngologists. In 1990, the number of visits with a principal diagnosis of otitis media per 100 persons per year in children younger than 2 years was 62.9 for pediatricians, 24.0 for general practitioners and family physicians, and 9.1 for otolaryngologists. In 1990, the number of visits with a principal diagnosis of otitis media per 100 persons per year in children 2 to 5 years old was 29.0 for pediatricians, 11.4 for general practitioners and family physicians, and 6.6 for otolaryngologists (Schappert, 1992).
The reports on the NAMCS data for 1993 to 1996 did not stratify by age (Schappert, 1996; Woodwell, 1997a; Woodwell, 1997b; Woodwell and Schappert, 1995). If the 1993-96 data were similar to that in 1975-90, it would be reasonable to conclude that the majority of these patients were younger than 15 years of age. Suppurative and unspecified otitis media was the third most frequently listed principal diagnosis in 1993, the sixth most frequent in 1994, the fourth most frequent in 1995, and the seventh most frequent in 1996 for ambulatory care visits to physician offices, hospital outpatient departments, and emergency departments (Schappert, 1996; Woodwell, 1997a; Woodwell, 1997b; Woodwell and Schappert, 1995). In 1996, visits for a principal diagnosis of otitis media and eustachian tube disorders occurred 82.8 percent of the time in physician offices, 5.3 percent in hospital outpatient departments, and 11.9 percent in emergency departments (Woodwell, 1997a).
Using the published NAMCS data and other published national data such as the National Health Interview Survey, an internal analysis estimated that 5.18 million episodes of AOM and 1.04 million episodes of OME or chronic middle ear infection following AOM occurred in 1995. Each episode of AOM entailed 1.75 visits to the physician, and each episode of OME or chronic middle ear infection entailed 5.1 visits to the physician. The analysis assumed that 20 percent of AOM episodes were followed by OME or chronic middle ear infection. (See Appendix A.)
The NAMCS data also provided information on the duration of office visits for otitis media. The percent of visits for otitis media of 6-15 minutes duration increased between 1975 and 1990 from 64 to 78 percent and was associated with a decrease in visits of less than 6 minutes in duration from 24 to 13 percent (Schappert, 1992). In terms of surgical procedures, the rate of ambulatory surgery visits per 10,000 population for those younger than 15 years of age for otitis media and eustachian tube disorders was 86.9 in 1994 and 83.9 in 1995, based on 498,000 and 484,000 visits respectively (Hall and Lawrence, 1997; Kozak, Hall, Pokras, et al., 1997). In 1995, the number of myringotomy with tympanostomy tube placements reported by NAMCS was 521,000 for a rate of 90.2 procedures per 10,000 children younger than 15 years of age (Hall and Lawrence, 1997).
In general, the NAMCS data demonstrated the importance of otitis media -- and by implication AOM -- based on the prevalence and incidence of the disease and the frequency and duration of visits and surgical interventions.
Uhari, Mantysaari, and Niemela (1996) conducted a systematic review of studies on the risk factors for development of AOM. This review only searched for studies via MEDLINE and might not have been comprehensive in its scope. Based on the studies included in their study, Uhari, Mantysaari, and Niemela (1996) found the following factors to be associated with increased risk of AOM: family member having AOM, relative risk (RR) 2.63 (95 percent CI, 1.86 and 3.72); day care outside the home, RR 2.45 (95 percent CI, 1.51 and 3.98); family day-care setting vs. care at home, RR 1.59 (95 percent CI, 1.19 and 2.13); parental smoking, RR 1.66 (95 percent CI, 1.33 and 2.06); and pacifier use, RR 1.24 (95 percent CI, 1.06 and 1.46). Having at least one sibling and being in a day-care center also seemed to be associated with increased AOM risk; however, the actual relative risks were not reported. Breast-feeding for at least 3 months was associated with a decreased risk of AOM, RR 0.87 (95 percent CI, 0.79 and 0.95). Breast-feeding in general and breast-feeding for at least 6 months also seemed to be associated with decreased AOM risk; however, the actual relative risks were not reported. Being in a day-care center vs. a family day-care setting did not confer a significant risk for AOM.
Uhari, Mantysaari, and Niemela (1996) also examined the risk factors for recurrent AOM and found the following factors to be associated with an increased risk of recurrent AOM: having at least one sibling, RR 1.92 (95 percent CI, 1.29 and 2.85); child care outside of the home, RR 1.82 (95 percent CI, 1.21 and 2.73); parental smoking, RR 1.76 (95 percent CI, 1.36 and 2.28); and day-care center vs. care at home, RR 1.38 (95 percent CI, 1.19 and 1.61). Breast-feeding in general, RR 0.48 (95 percent CI, 0.32 and 0.72), and breast-feeding for 6 months or longer vs. breast-feeding for less than 6 months, RR 0.69 (95 percent CI, 0.49 and 0.97) were associated with a decreased risk of recurrent AOM. The following factors were not found to be significantly associated with recurrent AOM risk: family day-care setting vs. care at home, day-care center vs. family day-care setting, atopy or allergy, and breast-feeding for 3 months or longer vs. less than 3 months. Rosenfeld (1996) also cited the following factors as mentioned in the literature as risks for recurrence of AOM: young age (younger than 2 years old); multiple previous episodes; bottle feeding; history of ear infections in parents or siblings; and pacifier use.
Risk factors for the outcome of AOM at 2 months were studied by Froom, Culpepper, Bridges-Webb, et al. (1993). Children younger than age 13 months were less likely to be asymptomatic at 2 months than older children. In the study population, several factors had independent risk for poor symptomatic outcome 2 months following diagnosis of AOM. For children age 12 months or younger, the following factors were associated with poor 2-month outcome: history of serous otitis media, odds ratio (OR) 2.3 (95 percent CI, 0.95 and 5.70); episodes of AOM within the past 18 months, OR 1.9 (95 percent CI, 0.82 and 4.51); and male sex, OR 1.7 (95 percent CI, 1.00 and 3.00). For children age 13 months to 15 years, the following factors were associated with poor 2-month outcome: history of ear tubes, OR 2.3 (95 percent CI, 1.46 and 3.58); pus on examination, OR 2.2 (95 percent CI, 1.48 and 3.29); episodes of AOM within the past 18 months, OR 1.8 (95 percent CI, 1.31 and 2.37); and history of serous otitis media, OR 1.4 (95 percent CI, 1.00 and 1.88). Other studies found that bottle feeding, a history of ear infections in parents or siblings, and attendance at a day-care center were factors associated with persistent middle ear effusion after AOM.
Related to the issue of a uniform definition of AOM is the diagnosis of AOM and the criteria by which the diagnosis is made. Hayden (1980) reviewed 43 full-length articles on AOM that were selected from six journals published from 1955 to 1979. Forty percent of these articles did not describe the criteria by which the diagnosis of AOM was established. In the 26 articles that did describe criteria for the diagnosis of AOM, 18 unique criteria sets were found, and identical criteria sets usually were found in studies performed by the same investigator. These findings, however, are expected considering the lack of a uniform definition.
Rosenfeld (1996) listed the following as possible diagnostic criteria for AOM: acute symptoms either alone, in the presence of middle ear effusion, or without resolution after 24 to 48 hours; purulent otorrhea; bulging tympanic membrane; and middle ear effusion in the presence of acute symptoms. The Otitis Media with Effusion in Young Children. Clinical Practice Guideline (Stool, Berg, Berman, et al., 1994a) stated that pneumatic otoscopy was an appropriate technique to establish the presence of middle ear effusion and that tympanometry could be used as a confirmatory test. Barnett, Klein, Hawkins, et al. (1998) found that acoustic reflectometry was as effective as tympanometry when compared to the gold standard of tympanocentesis.
Froom, Culpepper, Grob, et al. (1990) found that a large proportion of physicians in their study were unsure of the accuracy of their diagnosis of AOM. They reported diagnostic certainty in 58 percent of patients younger than age 12 months, 66 percent of patients age 13 to 30 months, and 73 percent of patients older than age 30 months. Studies from the University of Pittsburgh indicated that practitioners could be trained to diagnose the various forms of otitis media more appropriately (Kaleida and Stool, 1992). The validated otoscopist studies were based on an algorithm which in one study (Mandel, Rockette, Bluestone, et al., 1987) was felt to have potential for systematic bias as judged by the OME Guideline Panel (Culpepper, Long, and Sisk, 1994). As with the issue of the definition, this systematic review required a consensus on the diagnostic criteria for AOM to evaluate the studies retrieved for analysis of the key questions. This process is described in the Methodology section.
Various medical and surgical treatments have been used for AOM. For the most part, medical treatment has concentrated on the administration of antibiotics, including penicillins, aminopenicillins, cephalosporins, carbacephems, macrolides, azalides, lincomycins, and combination antibiotics (Rosenfeld, 1996). However, the efficacy of antibiotics in comparison to observation has been in question. The Dutch standard of care is to observe the patient for 48 hours in select children older than age 2 years and for 24 hours in select children age 6 months to 2 years before initiating antibiotics (Froom, Culpepper, Jacobs, et al., 1997). Antibiotics are prescribed if clinical resolution does not occur during the observation period. Other issues pertinent to antibiotics are dose, schedule, and duration of treatment. Antihistamines and decongestants, although shown to be ineffective in the treatment of OME (Cantekin, Mandel, Bluestone, et al., 1983), and analgesics and antipyretics often are used as adjunctive therapies in the treatment of AOM and can be purchased over-the-counter without prescription. One topical analgesic has been shown to be effective in reducing the pain associated with AOM (Hoberman, Paradise, Reynolds, et al., 1997). Alternative medications also have been used and their effectiveness has been subjected to investigation (Barnett, Levatin, Klein, et al., 1999). Myringotomy plus amoxicillin has been shown to be no more effective than antibiotics alone (Kaleida, Casselbrant, Rockette, et al., 1991).
Rosenfeld (1996) suggested that AOM may be prevented through modification of environmental risk factors and through immunizations against both bacteria and viruses associated with AOM. Large doses of xylitol seemed to be effective in reducing the recurrence rate of AOM (Uhari, Kontiokari, and Niemela, 1998). Tympanostomy tubes (Casselbrant, Kaleida, Rockette, et al., 1992; Gebhart, 1981; Gonzalez, Arnold, Woody, et al., 1986) and adenoidectomy (Paradise, Bluestone, Rogers, et al., 1990) appeared effective in preventing recurrent otitis media.
The NAMCS data described practitioner followup patterns for management of AOM. In 1990, compared with 1975, return visits were scheduled to a greater extent (73.2 percent vs. 60.2 percent) for children age 0 to 5 years and to a less extent (46.6 percent vs. 58.3 percent) for those age 15 years or older. As noted above, the NAMCS data did not separate AOM from otitis media effusion (Schappert, 1992).
A wide range of short-term and long-term outcomes must be considered when assessing the effectiveness of treatments for AOM. The following are outcomes often measured in studies: total resolution of signs and symptoms of middle ear inflammation, persistent AOM, chronic OME, suppurative complications, chronic complications, hearing deficits, speech and language problems, behavior problems, and cognitive deficits (Rosenfeld, 1996). Suppurative complications include mastoiditis, petrositis, labyrinthitis, meningitis, subdural empyema, focal otitic encephalitis, brain abscess, and lateral sinus thrombosis (Bluestone and Klein, 1996). Sequelae of the disease include cholesteatoma, tympanosclerosis, chronic tympanic membrane perforation, and ossicular discontinuity and fixation (Bluestone and Klein, 1996; Rosenfeld, 1996).
Adverse effects of the treatments may occur. Antibiotics may lead to diarrhea, rash, anaphylaxis, and symptoms of the hematologic, cardiovascular, central nervous, renal, hepatic, and respiratory systems (Stool, Berg, Berman, et al., 1994b). Antimicrobial drug resistance also may increase with increased use of antibiotics (Dowell, Marcy, Phillips, et al., 1998). Antimicrobial drug resistance appears to be less common in the Netherlands (where antibiotics are not used as frequently for AOM) than in countries that use antibiotics routinely for AOM (Culpepper and Froom, 1997). Antihistamines and decongestants may lead to insomnia, drowsiness, behavior changes, changes in blood pressure, and seizures (Stool, Berg, Berman, et al., 1994). Myringotomy with tympanostomy tube insertion has the following possible adverse effects: external canal laceration, persistent otorrhea, granuloma formation, cholesteatoma, permanent perforation of the tympanic membrane, tympanic membrane flaccidity, retraction, tympanosclerosis, and tube intrusion into the middle ear cleft (Stool, Berg, Berman, et al., 1994).
Cost is another important outcome. Gates (1996b) estimated the cost of AOM for children age 0 to 4 years as $3.15 billion for the year 1994. Stool and Field (1989) estimated the cost of otitis media in general for children age 0 to 6 years as $2.2 to $3.4 billion for the year 1987. Using published NAMCS data, other published national data, and estimates from previously published cost analyses, an internal analysis estimated that the cost of AOM in 1995 was $2.98 billion. The estimated cost of AOM includes the cost of its sequelae. Based on findings by Berman, Roark, and Luckey (1994), it was assumed that OME or chronic middle ear infections followed an episode of AOM in 20 percent of cases. Costs for AOM and OME or chronic middle ear infections were estimated from the existent literature and included direct and indirect costs. The cost per episode for AOM was estimated at $214.19 and included 1.75 visits to a physician. The cost per episode for OME or chronic middle ear infection was estimated at $1,811 and included 5.1 visits to a physician. The estimated number of episodes of AOM and OME or chronic middle ear infection following AOM was described earlier. The $2.98 billion estimate is a minimum estimate because most of the assumptions were conservative. Sensitivity analysis indicated that the estimated national cost for 1995 could be as high as $6 billion. In any case, the national cost of AOM, whether accepting previous estimates or the internally derived estimate, is high. (See Appendix A.)
Ultimately, the importance of these outcomes is dependent on the viewpoint of the evaluator (Russell, Siegel, Daniels, et al., 1996). Furthermore, the perspective of the patient, parent, and physician must be taken into consideration. In general, the societal viewpoint is crucial in terms of balancing health-care costs against the nonhealth-care needs of society; but, the individual patient's condition and circumstances within the societal context also must be taken into account (Gold, Patrick, Torrance, et al., 1996). Quality of life and functional status may be more important than the individual medical outcomes listed above. For otitis media, including AOM, various paradigms for looking at quality of life and functional status are being developed (Alsarraf, Jung, Perkins, et al., 1998; Haggard and Smith, 1999a, 1999b; Rosenfeld, Goldsmith, Tetlus, et al., 1997).
The project team prepared a conceptual framework (Appendix B) for the management of AOM for the purpose of discussion and future development of the evidence report. It outlined 11 steps for the management of AOM: steps 1 through 6 related to initial evaluation and treatment and steps 7 through 11 related to followup care. Factors influencing outcomes, outcome measures, and decisions were noted as footnotes to the framework. The framework formed the basis on which key questions and the scope of the evidence report were developed. It was understood that not all steps could be addressed in this evidence report.
A total of 11 organizations were identified by the project team from whom nominations of technical experts and peer reviewers were solicited. The 11 organizations included: 3 topic-nominating partner -- the American Academy of Family Physicians, the American Academy of Pediatrics, and the American Academy of Otolaryngology-Head and Neck Surgery Foundation; 2 hearing and speech organizations -- the American Academy of Audiology (AAA) and the American Speech-Language-Hearing Association (ASHA); 1 multidisciplinary organization -- the Society for Ear Nose Throat Advances in Children (SENTAC); 2 managed care organizations -- PacifiCare Health Systems and Prudential HealthCare; 1 nurse practitioner organization -- the National Association of Pediatric Nurse Associates and Practitioners (NAPNAP); and 2 consumer groups -- Family Voices and Foundation for Accountability (FACCT). A letter of invitation to nominate technical experts and peer reviewers was faxed to each organization, together with a description of the tasks and commitments of each panel member.
| Technical Expert | Area of Expertise | Affiliation/Location |
|---|---|---|
| Theodore G. Ganiats, M.D. | Family medicine | University of California San Diego, CA |
| Martin C. Mahoney, M.D., Ph.D. | Family medicine | State University of New York Buffalo, NY |
| Margaretha Casselbrant, M.D., Ph.D. | Otolaryngology | Children's Hospital Pittsburgh, PA |
| Richard M. Rosenfeld, M.D., M.P.H. | Otolaryngology | SUNY Health Science Center Brooklyn, NY |
| Leonard B. Weiner, M.D. | Pediatrics, infectious diseases | SUNY Health Science Center Syracuse, NY |
| F. Lane France, M.D. | Pediatrics practice & ambulatory medicine | Tampa Bay Pediatrics Tampa, FL |
| Judith S. Gravel, Ph.D. | Audiology | Albert Einstein College of Medicine Bronx, NY |
| Joanne Roberts, Ph.D. | Speech-language and audiology | Frank Porter Graham Child Development Center Chapel Hill, NC |
| Tony Arboleda, M.D. | Health plan | MedPartners Medical Group Burbank, CA |
| Janice Goertz, R.N.,CPNP | Nurse practitioner | Portage, MI |
| Jennifer Postley, B.A. | Consumer | Family Voice Los Angeles, CA |
A draft workplan for the topic assessment and refinement phase was mailed to the technical experts and partners for review and comments. Two conference calls among all technical experts, partner liaisons, project staff, and the Task Order Officer were held to review data on existing literature, refine the causal pathway, specify patient populations and practice settings, and refine the key questions to be addressed in the evidence report. The conference calls were chaired by the Principal Investigator and were attended by all principal project staff, the technical experts, and the AHRQ Task Order Officer. Reference materials -- including a review of the existing literature, causal pathways, conceptual framework, and a list of potential questions -- were mailed to all participants prior to the calls.
The project staff compiled a summary of information on:
The incidence and prevalence of AOM, treatment and management alternatives, characteristics and size of the affected populations, and the most affected practice settings and providers.
The burden of illness associated with AOM, including morbidity, mortality, impact on developmental milestones, quality of life, loss of productivity, medical costs to treat the condition, and other economic costs or burdens associated with the condition.
The extent to which there is variation in practice associated with the prevention, diagnosis, treatment, or management of AOM.
Further, we reviewed and compiled a summary of six meta-analyses on otitis media that already had been conducted. Both summaries were distributed to the technical experts between the first and second conference call. The project staff also examined in detail the OME Guideline Panel's report Managing Otitis Media with Effusion in Young Children. Quick Reference Guide for Clicians (Stool, Berg, Berman, et al., 1994b) for parallel issues in AOM.
About 2 weeks before the first conference call, the following documents were distributed to the technical experts: (1) the preliminary conceptual framework for management of AOM,(2) the two-page letter nominating AOM as a topic for evidence analysis that was submitted to AHRQ by the three nominating agencies, (3) a list of the key questions included in the Request for Task Order by AHRQ, and (4) the draft workplan for topic assessment and refinement. Each technical expert was asked to submit a list of key questions within a week using the conceptual framework as a guide and to provide comments and any suggestions for revision of the conceptual framework and the draft workplan for topic assessment and refinement. The letter to the technical experts emphasized that not all steps in the framework would be addressed in the evidence report and that only three to five key questions would be selected.
The project staff compiled a master list of proposed key questions that incorporated the key questions submitted by the technical experts. The master list was forwarded to all technical experts and conference call participants and was used as the basis for discussion during the first conference call.
Question 1: On the Natural History of
AOM.
What clinical characteristics
(history, symptoms, physical findings) of children are
associated with rapid improvement and with prolonged duration of
morbidity during an episode of (uncomplicated) acute otitis
media (AOM) that is initially managed WITHOUT antibiotics in
terms of:
|
Question 2: On Definition and Physician Diagnosis of
AOM.
How accurate is physician/health
care provider diagnosis of acute otitis media?
|
Question 3: On Antibiotic Treatment of
AOM.
Are antibiotics (compared to
placebo) effective (in terms of statistical significance and
magnitude of absolute clinical benefit above and beyond natural
history) in treatment of AOM with respect to the following
outcome indicators:
|
Question 4: On Antibiotic Regimen for
AOM.
Does the specific antibiotic regimen
make a difference?
|
Question 5: On Non-Antibiotic Pharmaceutical Treatment of
AOM.
What is the effectiveness (or
cost-effectiveness) of non-antibiotic treatments of AOM?
|
Question 6: On Followup Strategies.
What are the appropriate (and/or cost-effective) clinical
followup strategies (including type, schedule, and frequency of
strategies) for children with AOM?
|
Question 7: On Prevention of AOM.
What is the role of each of the following preventive strategies
in managing sporadic or recurrent AOM?
|
AOM=acute otitis media; MEE=middle ear effusion.
The new set of seven key questions -- together with a form to record rankings, the summary of information on the incidence, alternatives for treatment, and impact/costs of AOM; the summary of published meta-analyses; and preliminary counts of citations by key questions -- was sent to the technical experts about 1 week before the second conference call. The technical experts were advised to use the background materials as references to rank five of the seven key questions, using "5" as the most important and "1" as the least important. The main criteria to be used in ranking were importance and feasibility. Importance was to be determined by the potential impact on the outcomes associated with the management of AOM. The importance of a question might be diminished if a recent evidence analysis of high quality already existed. Feasibility was determined by the availability of published studies and the time required to complete the evidence analysis for that question. Technical experts were asked to submit the ranking to the Task Order Coordinator before the second conference call.
| Technical Expert | Key Question for Ranking | ||||||
|---|---|---|---|---|---|---|---|
| Q1 Natural History | Q2 Definition and Diagnosis | Q3 Antibiotic vs. No Antibiotic | Q4 Antibiotic Regimen | Q5 Non-Antibiotic Treatment | Q6 Followup Strategy | Q7 Prevention | |
| T1 | 5 | 4 | 3 | 0 | 0 | 1 | 2 |
| T2 | 4 | 3 | 2 | 5 | 1 | 0 | 0 |
| T3 | 1 | 0 | 5 | 4 | 0 | 3 | 2 |
| T4 | 5 | 0 | 1 | 2 | 0 | 3 | 4 |
| T5 | 5 | 0 | 1 | 2 | 0 | 3 | 4 |
| T6 | 5 | 4 | 2 | 3 | 0 | 1 | 0 |
| T7 | 3 | 0 | 4 | 1 | 0 | 5 | 2 |
| T8 | 2 | 1 | 5 | 4 | 0 | 3 | 0 |
| T9 | 0 | 5 | 4 | 0 | 1 | 2 | 3 |
| T10 | 3 | 1 | 5 | 2 | 4 | 0 | 0 |
| T11 | 0 | 5 | 2 | 4 | 0 | 3 | 1 |
| Total Rank | 33 | 23 | 34 | 27 | 6 | 24 | 18 |
Note: The technical expert numbers were assigned randomly and do not correspond to the listing order.
Question 1: On the Observational or No Treatment or
Natural History of AOM.
|
Question 3: On Antibiotic Treatment of AOM.
|
Question 4: On Antibiotic Regimen for
AOM.
Does the specific antibiotic regimen
make a difference?
|
An episode of uncomplicated AOM may be considered distinct from a previous episode of AOM and eligible for "initial" treatment if the most recent course of antibiotic ended 4 weeks prior to the episode of AOM in question or if there is documentation by an examiner that a prior episode of AOM has been cleared.
Several issues were brought up during the discussion and were addressed during the revision of the key questions and the drafting of the causal pathways:
One issue related to the difference between "natural history of acute otitis media when nothing is done, including not seeking care from the health care provider" and "observational treatment prescribed by the health care provider." It was decided that the issue brought up an important point, and Question 1 was retitled to reflect this fact.
Another issue concerned the real objective of Question 3b. The technical experts discussed whether it was more important to address the amount of influence of the listed factors on the "selective initial use of antibiotics" or to address the "effectiveness of the initial use of antibiotics." The former is an analysis of the prescribing pattern (which is a process variable), and the latter is an analysis of the effectiveness of initial use of antibiotics (which is an outcome variable). Question 3b was thus reworded to address the impact of these factors on outcome.
On the issue of defining uncomplicated AOM, there were several suggestions, including "inflammation of the middle ear cleft" to "one sign and one symptom" to "definitions used by the different studies." The project team decided that a definition and diagnostic criteria had to be established before the study could continue because it would affect the search strategy. The experts were polled to establish the best definition to use for this evidence report. Several of the technical experts felt that we might have to accept whatever definition of AOM was found in any given study because they would be quite disparate; however, the project staff felt it important to establish a standard definition for comparison.
Subquestions in Question 4 that addressed complicated AOM rather than uncomplicated AOM were discussed: (4b) Would antibiotic selection based on local or regional bacterial resistance pattern improve the outcome of antibiotic treatment of AOM? and (4h) How long after an antibiotic is used is it reasonable for it to be used again to treat AOM in terms of reducing the likelihood of developing resistance to antibiotics? They were not included because this evidence report was limited to uncomplicated otitis media.
The definition of endpoints for the study was discussed. The group decided to leave them open to definitions used by different studies. However, it was decided that it would be important to define the most appropriate endpoints before the literature search and then compare the definitions with those found and/or used in the literature.
The next discussion topic was on the age of the child to be included in the evidence report. It was decided to exclude the neonate. Epidemiologically, a neonate is a newborn up to 28 days old. For this evidence report, studies on children between age 28 days and 18 years were included.
The following factors that might affect outcomes were added: gender, ethnicity, presence of ear infection in sibling, craniofacial problems, and cost. In addition, based on information from review of literature, project staff added race, sibling(s) in day care, pacifier use, presence of sibling(s), and atopy or allergy. In this report, the term "influencing factors" included both risk factors and effect modifiers that might actually or potentially affect the outcomes.
![]() |
| Key Question | Search Topic | MEDLINE (1966- 1998) |
|---|---|---|
| Natural History | AOM and natural history or untreated | 7 |
| AOM and outcome & process assessment | 95 | |
| AOM and persistent | 110 | |
| AOM and recurrent | 284 | |
| AOM and complications | 322 | |
| Definition & Diagnosis | AOM and blood, microbiology, csf, classification, cytology, parasitology, diagnosis, radiography, radionuclide imaging, urine, virology | 525 |
| AOM and sensitivity/specificity/false-negative/false-positive/predictive/likelihood/randomized controlled trial/blinded methods | 468 | |
| AOM and diagnosis/diagnostic techniques and procedures/laboratory techniques | 498 | |
| AOM and sensitivity/specificity/predictive value/likelihood | 63 | |
| AOM and medical history taking | 5 | |
| AOM and physical exam | 39 | |
| AOM and tympanogram | 29 | |
| AOM and tympanocentesis | 93 | |
| AOM and acoustic reflectometry | 9 | |
| AOM and diagnostic techniques otological | 124 | |
| AOM and otoscopes/otolaryngology (MeSH 1998+) | 5 | |
| AOM and decisionmaking/judgment/problem solving/decision support techniques/physician's practice patterns/referral and consultation/evidence-based medicine | 45 | |
| Antibiotic Therapy | AOM and antibiotics | 790 |
| Non-Antibiotic Therapy | AOM and steroids | 22 |
| AOM and analgesics | 29 | |
| AOM and antihistamines/decongestants | 44 | |
| AOM and tympanostomy/middle ear ventilation/tympanostomy/tube insertion | 111 | |
| Followup Strategy | AOM and combination of therapies and followup studies | 77 |
| Prevention | AOM and antibiotic prophylaxis/preventive medicine/immunoprophylaxis | 136 |
| Review Articles | ||
| General | AOM and review articles and human and English | 172 |
| Cost 1 | AOM and cost 1 | 52 |
| Meta-analysis | AOM and meta-analysis | 27 |
| AOM and information synthesis (meta-analysis, decision analysis, cost effectiveness analysis, cost-benefit analysis) | 29 | |
| Incidence/Prevalence | AOM and incidence/prevalence | 251 (1966- 1998) |
| 148 (1987- 1998) | ||
| Randomized Control Trials (RCTs) | ||
| RCT | AOM and RCT as publication type | 198 (1966- 1998) |
| 129 (1987- 1998) | ||
| AOM and RCT (very broad strategy) | 617 (1966- 1998) | |
| 441 (1987- 1998) | ||
1 From HealthSTAR, 59 citations from 1966- 1998.
The three key questions, definition of AOM, and the scope of the evidence report have gone through several revisions as a result of conference discussions and polling. The initial and revised versions of these three documents are included in Appendices C, D, and E, respectively.
During the second conference call, the technical experts provided input regarding the patient populations, practice settings, and target audience for the evidence report. The study population included all children between 28 days and 18 years with uncomplicated AOM. The interventions of interest included placebo or observation with no treatment or antibiotic treatment. Influencing factors included demographic, environmental, clinical, pharmaceutical, and cost factors. All health care settings and types of providers were included. The endpoints of the study included four short-term and four long-term indicators. Short-term indicators at 48 hours included disappearance of signs (discharge, inflammation of the tympanic membrane), symptomatic relief of pain and/or fever, resolution of acute suppurative complications, and complete clinical resolution (except middle ear effusion). Long-term indicators at 3 months included absence of asymptomatic middle ear effusion, resolution of suppurative complications (e.g., mastoiditis), absence of speech and/or hearing problems, and absence of recurrence of AOM.
| Expert Number | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | |
| 1. Definition of Rapid Onset: | |||||||||||
| (a) Within 48 hours | x | x | . | x | x | x | x | . | x | x | x |
| (b) Within 7 days | . | . | . | . | . | . | . | x | . | . | . |
| (c) Other (72 hours) | . | . | x | . | . | . | . | . | . | . | . |
| 2. GI symptoms to be included? | |||||||||||
| (a) Yes | . | . | x | x 2 | . | . | . | . | . | . | . |
| (b) No | x 1 | x | . | . | x | x | x | x | x | x | x |
| 3. Hearing loss included? | |||||||||||
| (a) Yes | x | . | x | . | . | x | . | x | x 5 | x 5 | x |
| (b) No | . | x | . | x 3 | x | . | x 4 | . | x 5 | x 5 | . |
| 4. The two signs for MEE | |||||||||||
| (a) Agree | x 6 | x | x 7 | . | x | x | . | x | x 10 | x 10 | x |
| (b) Disagree | . | . | . | x 8 | . | . | x 9 | . | . | . | . |
Notes:
x Answer checked by expert.
GI findings can occur, but to have rapid onset of GI findings and an abnormally colored ear doesn't make it for me.
GI symptoms should be included on the list because they may be the only manifestation of acute illness in an infant or young child. Anorexia (secondary to nausea) and vomiting may be direct vestibular manifestations of middle ear infection or fluid. Diarrhea is not as easy to justify, and if the panel feels strongly about removing diarrhea from the symptom list I have no objection. Be aware, however, that "traditional" AOM definitions have always included diarrhea as a qualifying symptom.
Hearing loss is a manifestation of middle ear effusion, not acute infection. Further, not all middle ear fluid is accompanied by hearing loss, and not all hearing loss caused by middle ear fluid is readily perceptible to parents or clinicians. Traditional AOM definitions have never included hearing loss as a qualifying symptom.
Anyone with AOM will have hearing loss at diagnosis.
We are concerned about including hearing loss as a clinical finding. First, it is highly unlikely that a formal audiologic evaluation would be administered when a child presents to the physician with acute OME. Clinical symptoms (fever, irritability, otorrhea, otologia) could prevent a reliable hearing test (audiogram and tympanogram) from being obtained. During the course of the episode when the acute clinical symptoms had subsided, an audiologic evaluation would be more appropriate. Second, without a direct measure of hearing (that is, obtaining an audiogram) there is no way to determine if hearing loss exists. Parent report has been demonstrated to be a highly inaccurate means of detecting hearing loss (Rosenfeld et al.). Further, we are not uncertain if studies examining hearing loss and OM have specifically examined hearing loss during AOM. However, if hearing loss stays in as a clinical finding, please delete "older children." Hearing loss, when present, occurs in both young children as well as older children, and can be reliably assessed in infants and young children. Therefore, hearing loss would be a clinical finding regardless of the age of the child.
Need to clarify one or both signs.
Change 3(b) to full or bulging with red or white opacification.
Middle ear fluid with AOM generally manifests as a full or bulging tympanic membrane, which is opaque and has limited or absent mobility to pneumatic otoscopy. Changes in tympanic membrane color are NOT indicative of effusion. Changes in lucency are also NOT indicative, unless accompanied by reduced mobility.
Suggest that OME and inflammation with changes go under part two.
We agree with the addition with of the two clinical signs, but suggest that position of the TM (e.g., bulging, retracted) be included as a third clinical sign (Karma Penttila, Sipila, et al., 1989).
Comment 1: I continue to be troubled by the AOM
definition as it seems to confuse the terms "symptom" &
"sign."
| ||||
| Specifically, the current AOM definition (12/23) seems to mix signs & symptoms in items #2 & 3. Symptoms would include ear pulling, irritability, otalgia (subjectively) & hearing loss (subjectively), while signs include otalgia, otorrhea, fever, and hearing loss (objectively). Also, the basic elements which define inflammation (e.g., redness, pain, fever, swelling) are not consistently addressed in the present definition. | ||||
| Comment 2: Revised proposed AOM definition. I still have some problems with the wording. As noted in a prior e-mail, I recommend the following definition: | ||||
| "Acute otitis media is defined as: 1) signs of middle-ear effusion (new onset or pre-existing) accompanied by 2) rapid and short onset (within 48 hours) of clinical findings including one or more of the following: otalgia (ear pulling in an infant), otorrhea, fever, irritability, anorexia, vomiting, or diarrhea." | ||||
| In contrast to your proposed definition, the one above puts emphasis on middle-ear effusion (by placing it first) and eliminates ambiguity about middle-ear effusion duration (your definition implies recent onset, yet AOM can develop on a pre-existing effusion of long duration). |
| ||||||
| Comments: | ||||||
| ||||||
| Comments: | ||||||
|
| Expert | Issue 1 | Issue 2 | Issue 3 | Issue 4 |
|---|---|---|---|---|
| 1 | Yes | <=48 hours from point signs/symptoms noted by parent and health system contacted 4 | b | a |
| 2 | Yes | <=48 hours from point of initial signs/symptoms | c | four episodes in 12 months |
| 3 | Yes | <=48 hours from point signs/symptoms noted by parent and health system contacted | a and c | a 7 |
| 4 | No | <=48 hours from point signs/symptoms noted by parent and health system contacted | b 6 and c | a 8 |
| 5 | No preference 2 | <=48 hours from onset of acute signs or symptoms until diagnosis confirmed by practitioner | b and c | a |
| 6 | Yes | <=48 hours from point signs/symptoms noted by parent and health system contacted | b and c | a |
| 7 | No 3 | <=48 hours from point signs/symptoms noted by parent and health system contacted5 | b | a |
| 8 | No | <=48 hours from point signs/symptoms noted by parent and health system contacted | a | a |
| 9 | No preference | <=48 hours from point signs/symptoms noted by parent and health system contacted | c | a |
| 10 | Yes | <=48 hours from point signs/symptoms noted by parent and health system contacted | c | a |
Issues: Issue 1: In the definition of AOM, should we add "excluding retracted tympanic membrane" to statement (1)? Issue 2: In the definition of AOM, the majority of you defined rapid onset as "within 48 hours..." Please write down the beginning and end points to define rapid onset. Issue 3: In the key questions, we need to define "initial treatment" or "initially managed." We are proposing the following options [circle (a), (b), and/or (c)]: (a) An episode of uncomplicated AOM may be considered distinct from a previous episode of AOM and eligible for "initial treatment" if the most recent course of antibiotic ended 2 weeks prior to the episode of AOM in question. (b) An episode of uncomplicated AOM may be considered distinct from a previous episode of AOM and eligible for "initial treatment" if the most recent course of antibiotic ended 4 weeks prior to the episode of AOM in question. (c) An episode of uncomplicated AOM may be considered distinct from a previous episode of AOM and eligible for "initial treatment" if there is documentation by an examiner that a prior AOM has been cleared. Issue 4: One of the influencing factors in the scope is "otitis prone," which is used to replace "prior history of recurrent AOM" and "multiple previous episodes." How would you define "otitis prone?" [circle one]: (a) three episodes in 6 months or four episodes in 12 months; (b) other (please specify and write rationale).
"I remain troubled by the definition. For example, a child with stable OME who develops febrile rotavirus diarrhea meets the definition (whether they have any of the 1) a, b, or c findings). I'm not sure how that can work."
"Unless there is evidence to support its use in diagnosis, remove acoustic "reflectometry" from Definition as well as in Scope of the Evidence Report: Monitoring during episode. (See section on acoustic reflectometry in Clin. Pract. Guideline 12 on OME, Stool, et al., 1994, p. 34-35.)
"I always thought 'within 48 hours' referred to the speed of onset, not the duration. If we go with duration, I think your example is fine. If we go with speed, I have a hard time coming up with the right words."
"I Agree with above, but change 'physician' to 'examiner' (to include family physician, otolaryngologist, pediatrician, nurse practitioner, PA, etc.)."
"AOM within 4 weeks of a prior episode would classify as recurrence."
"Patient should also be asymptomatic."
"In the context of an 'influencing factor' you may wish to expand this definition to include episodes of OME, not just AOM." "Episodes should also be 'well documented and separate.'"
OME=otitis media effusion.
Based on the responses to the unresolved issues, the three documents were revised further. The next set of revisions of the key questions, definition, and scope (Appendices C.3, D.3, and E.3) were distributed to the panel of experts for review and for discussion at the third conference call and resulted in more changes. The final revisions of the three documents are included in Appendices C.4, D.4, and E.4.
The short version of the final definition of AOM is as follows: Acute otitis media is the presence of middle ear effusion in conjunction with the rapid onset of one or more signs or symptoms of inflammation of the middle ear.
The long version of the final definition is as follows:
Presence of middle ear effusion as demonstrated by the actual presence of fluid in the middle ear as diagnosed by tympanocentesis or the physical presence of liquid in the external ear canal as a result of tympanic membrane perforation or indicated by limited or absent mobility of the tympanic membrane as diagnosed by pneumatic otoscopy, tympanogram, or acoustic reflectometry with or without the following: (a) opacification, not including erythema, (b) a full or bulging tympanic membrane, or (c) hearing loss, and rapid onset (i.e., up to 48 hours from the onset of acute signs or symptoms first noted by the parent or guardian to the time of contact with the health system) of one or more of the following signs or symptoms, with or without anorexia, nausea, or vomiting: (a) otalgia (or pulling of ear in an infant), (b) otorrhea, (c) irritability in the infant or toddler, or (d) fever.
We conducted the literature search on seven databases: MEDLINE, the Cochrane Library, HealthSTAR, International Pharmaceutical Abstracts (IPA), Cumulative Index to Nursing and Allied Health Literature (CINAHL), BIOSIS, and EMBASE. We also searched for relevant articles in symposiums and reference lists of published articles, reports, and guidelines.
The MEDLINE database is produced by the U.S. National Library of Medicine and is widely recognized as the premier source for bibliographic coverage of biomedical literature. It encompasses information from Index Medicus, Index to Dental Literature, and International Nursing, as well as other sources of coverage in the areas of allied health, biological and physical sciences, humanities and information science as they relate to medicine and health care, communication disorders, population biology, and reproductive biology. The MEDLINE database includes citations and abstracts since 1966.
The Cochrane Library contains several databases: (1) The Cochrane Database of Systematic Reviews containing Cochrane reviews published by the Cochrane Collaboration, an international organization dedicated to applying evidence-based medicine principles to the review of important clinical topics; (2) The Cochrane Controlled Trials Register, which is a bibliographic database of controlled trials; (3) The Database of Abstracts of Reviews of Effectiveness (DARE), which includes structured abstracts of systematic reviews that have been critically appraised by reviewers at the NHS Centre for Reviews and Dissemination in York and by other reviewers (e.g., the American College of Physicians' Journal Club and the journal Evidence-Based Medicine); and (4) The Cochrane Review Methodology Database, which is a bibliography of articles on the science of research synthesis.
The HealthSTAR database contains citations and abstracts (when available) of journal articles, monographs, technical reports, meeting abstracts and papers, book chapters, government documents, and newspaper articles on health services, technology, administration, and research. It focuses on both the clinical and nonclinical aspects of health care delivery. Topics covered include evaluation of patient outcomes; effectiveness of procedures, programs, products, services and processes; and health services research. It is produced cooperatively by the U.S. National Library of Medicine and the American Hospital Association. HealthSTAR replaces the former Health Planning and Administration database. The database includes citations and abstracts since 1975.
The IPA is produced by the American Society of Health System Pharmacists. It provides worldwide coverage of pharmaceutical science and health-related literature. Coverage includes drug therapy, toxicity, and pharmacy practice, as well as legislation, regulation, technology, utilization, biopharmaceutics, information processing, education, economics, and ethics as related to pharmaceutical science and practice. The database currently contains over 300,000 records and includes citations since 1970.
The CINAHL database is produced by CINAHL Information Systems. It provides comprehensive coverage of the English-language journal Literature for Nursing and Allied Health Disciplines. Material from more than 950 journals is included in CINAHL. Also included are health care books, nursing dissertations, selected conference proceedings, standards of professional practice, and educational software. There is selective coverage of journals in biomedicine, the behavioral sciences, management, and education. The database currently contains over 250,000 records. In total, more than 500 journals are regularly indexed; online abstracts are available for more than 150 of these titles. The database includes citations since 1982.
BIOSIS Previews, produced by BIOSIS, is the world's most comprehensive reference database in the life sciences. It covers original research reports and reviews in biological and biomedical areas. Nearly 7,000 serials are monitored for inclusion. In addition, the database covers content summaries, books (including software from 1992 to present), and information from meetings. Content summaries include notes and letters, technical data reports, reviews, U.S. patents from 1986 to 1989, translation journals, meeting reports from 1980 to present, bibliographies, nomenclature rules, and taxonomic keys. The BIOSIS Previews database includes the contents of Biological Abstracts (1969 to present), Biological Abstracts/RRM (1980 to present), and BioResearch Index (1969 to 1979). The BIOSIS database includes citations since 1970.
EMBASE, the Excerpta Medica database produced by Elsevier Science, is a major biomedical and pharmaceutical database indexing more than 3,800 international journals. EMBASE is one of the most widely used biomedical and pharmaceutical databases. The database currently contains more than 6 million records, with more than 400,000 citations and abstracts added yearly. The EMBASE database contains citations since 1980.
The project librarian developed an overall search strategy incorporating the input from the technical experts and following the scope of the project. The initial search strategy was developed for MEDLINE and then customized for the other databases. The MEDLINE search strategy used both controlled vocabulary terms and keywords. The strategy was organized into modules or clusters of search statements. The initial module (called om with sh dt or otitis media with subheading drug therapy) included using what is referred to as an "explode" of om, which includes the controlled vocabulary headings om, mastoiditis, om w/effusion, om, suppurative with the subheading drug therapy. The next module (called om) included the explode of om as well as om as a text word. The anti-infectives module used explode of the mesh heading for anti-infective agents, which includes antibiotics and other drug groups as well as the text words antibiotic, antimicrobial, and antibacterial. The antibiotics module included the names of specific antibiotics previously identified, which were entered as text words. The search involved a combination of the om module with the anti-infectives module and another combination of the om module with the antibiotics module. We also used either the om with dt set or the om with anti-infectives set or the om with antibiotics as a keyword set in the search. From this set editorials, letters, reviews, practice guidelines, consensus development conferences, and case reports were excluded, except when the case report was also a randomized controlled trial or clinical trial. This set was then limited to human or undesignated. In other words, animal studies were excluded. The final set was limited to infant, child, preschool, adolescence, or undesignated. Newborn, adult, middle age, and aged were excluded.
For the search for natural history, natural history, natural course, and untreated were added as keywords. During the third telephone conference with the technical experts, an expert advised adding "spontaneous" and "self-limited" as keywords to the search. Adding these terms, however, uncovered no additional articles.
The first MEDLINE search resulted in 2,284 titles/abstracts. Two subsequent MEDLINE alerts (additions of new articles after the last update) added another 27 titles/abstracts. Additional titles/abstracts included 217 from the Cochrane Library search, 11 from the HealthSTAR search, 88 from the CINAHL search, 248 from the IPA search, 745 from the BIOSIS search, and 2,418 from the EMBASE search. Further screening of and removal of duplicates from BIOSIS and EMBASE resulted in retaining 154 titles/abstracts from BIOSIS and 421 from EMBASE. The search strategy included the following criteria: publication years after 1966, all languages, keywords, human or non-human study, and search hierarchy. The ending date of all searches was March 31, 1999. All databases were searched using the Ovid search system through the World Wide Web with the exception of the Cochrane Library. The files searched included the Cochrane Database of Systematic Reviews, DARE, and The Cochrane Controlled Trials Register.
EndNote software (EndNote Windows Version 3.0, 1st Edition. Niles Software Inc., Berkeley, CA) was used to keep a complete record of all titles/abstracts and to identify duplications. It was able to store, organize, and track references by source (e.g., identified in MEDLINE), search strategy (date of search, index code specifying search criteria used), and a unique identification (UI) code for each article (assigned by source used to find article). Electronic removal of duplicate citations was supplemented by manual cross-checking. In the event an article was identified through an expert panel member or reference checking, the title and author of the reference were entered into MEDLINE through the Ovid search system (Ovid Technologies, Inc. 1998, Version: 7.8 Millennium source ID 1.3932.1.156.1.7, Revision: 1.303.2.8) to determine the UI. If a UI could not be found for the article, an alternate identification code was assigned.
EndNote assigned a record number to each new reference added to the master file. This number would not change once an article was added to the list and was used, in addition to the UI, to sort references for article retrieval and review.
Upon completion of the literature search and duplicate checking, the master list generated from EndNote was exported to a Microsoft Excel spreadsheet for data export for analysis. Codes including status of article retrieval, reviewer, and the results of the review were added.
After retrieval of titles and abstracts from the literature search, two physician reviewers reviewed the abstracts against the inclusion/exclusion criteria to determine eligibility for inclusion in the evidence synthesis as defined in the scope and key questions. Titles/abstracts were not masked prior to review. A predesigned screening form (Appendix F) was used to record the reviews. Instructions for screening also were provided (Appendix F). The screening results for each title/abstract were matched between the two reviewers by the Task Order Coordinator. Discrepancies on inclusion or exclusion were resolved in conference among the two reviewers and the coordinator. The data were entered into a Microsoft Excel database from which interrater reliability statistics of agreement and agreement adjusted for chance (kappa statistic) were calculated. Summary reports indicated those abstracts that passed the screening criteria and those that failed, along with the reasons for failure.
| Source | Total Title/Abstract | Before Resolution | After Resolution | ||||
|---|---|---|---|---|---|---|---|
| Reject | Accept | Unsure | Reject | Accept | |||
| MEDLINE | 2,322 | 1,800 (78%) | 259 (11%) | 263 (11%) | 1,931 (83%) | 391 (17%) | |
| Cochrane Library | 217 | 161 (74%) | 46 (21%) | 10 (5%) | 163 (75%) | 54 (25%) | |
| HealthSTAR | 11 | 5 (46%) | 1 (9%) | 5 (46%) | 9 (82%) | 2 (18%) | |
| CINAHL | 88 | 79 (90%) | 1 (1%) | 8 (9%) | 83 (94%) | 5 (6%) | |
| IPA | 248 | 210 (85%) | 27 (11%) | 11 (4%) | 239 (96%) | 9 (4%) | |
| BIOSIS | 154 | 41 (27%) | 75 (49%) | 38 (25%) | 53 (34%) | 101 (66%) | |
| EMBASE | 421 | 204 (48%) | 101 (24%) | 116 (28%) | 223 (53%) | 198 (47%) | |
| All Sources 1 | 3,461 | 2,500 (72%) | 510 (15%) | 451 (13%) | 2,701 (78%) | 760 (22%) | |
1Citations from each source are not independent.
CINAHL=Cumulative Index to Nursing and Allied Health Literature; IPA=International Pharmaceutical Abstracts.
The titles/abstracts identified as requiring further review were forwarded to the library for full article retrieval. Libraries at both the Los Angeles County - University of Southern California Medical Center and at the University of Southern California Health Sciences Campus were the primary sources of the articles. Those not found were retrieved through the Inter-Library Loan Program.
Because a large number of titles/abstracts had inadequate information for full evaluation, a second screening with the full articles was conducted. Like the first screening, two physician reviewers independently reviewed each article and filled out a screening form. Articles were not masked prior to review. Discrepancies on inclusion/exclusion were resolved through conference calls.
| English | Non-English | |
|---|---|---|
| Total Number of Articles Number of Articles obtained, not reviewed Number reviewed Number rejected Number accepted | 487 0 487 415/487 (85%) 72/487 (15%) | 273 176 97 95/97 (98%) 2/97 (2%) |
| For Rejected Articles: Reason of Rejection R1=Not a study R2=Nonhuman subjects R3=Not on acute otitis media R4=Not in age range of study R5=Study population not in scope R6=Study design not appropriate R7=Not addressing any key questions 1 R8=Duplicate of other studies R9=Data not abstractable, require contacting author | 415 56 (13%) 2 (0%) 41 (10%) 1 (0%) 0 (0%) 25 (6%) 228 (55%) 28 (7%) 34 (8%) | 95 19 (21%) 2 (2%) 16 (17%) 11 (12%) 0 (0%) 1 (0%) 37 (39%) 9 (9%) 0 (0%) |
| For Accepted Articles: Key Questions Addressed (n=74) Key Question 1: Natural History of AOM 2 Key Question 3. Use of Antibiotics 3 Key Question 4a: Amoxicillin or TMP-SMZ 4 vs. others Key Question 4b: Oral fluoroquinolones vs others Key Question 4c: High-dose vs. standard-dose amoxicillin Key Question 4d: Bid vs. tid high-dose amoxicillin Key Question 4e: Short- vs. long-term antibiotic therapy | 72 10 8 34 0 1 1 35 | 2 0 0 0 0 0 0 2 |
163 of the 228 addressed potential key questions.
Four articles were added to Key Question 1 after review of references of other articles.
One article was added to Key Question 3 after review of references of other articles.
4 TMP-SMZ: trimethoprim-sulfamethoxazole
Of the 72 English articles eligible from the electronic search, 10 addressed the natural history question (Key Question 1), 8 addressed the use of antibiotic question (Key Question 3), 34 addressed the comparison of amoxicillin or ampicillin with other antibiotics (Key Question 4a), none addressed the comparison of oral fluoroquinolones with other antibiotics, 1 addressed the comparison of high dose vs. standard dose of amoxicillin, 1 compared twice a day vs. three times a day of amoxicillin, and 35 compared short-term versus long-term antibiotic therapy.
| Language | First Batch 1 N=2,875 | Second Batch 2 N=585 | Total |
|---|---|---|---|
| Japanese | 22 | 79 | 101 |
| French | 17 | 12 | 29 |
| German | 14 | 10 | 24 |
| Russian | 13 | 3 | 16 |
| Italian | 6 | 16 | 22 |
| Spanish | 4 | 17 | 21 |
| Danish | 7 | 3 | 10 |
| Portuguese | 1 | 9 | 10 |
| Polish | 8 | 0 | 8 |
| Dutch | 4 | 2 | 6 |
| Swedish | 3 | 0 | 3 |
| Norwegian | 2 | 0 | 2 |
| Romanian | 2 | 0 | 2 |
| Czech | 0 | 1 | 1 |
| Finnish | 1 | 0 | 1 |
| Hebrew | 1 | 0 | 1 |
| Turkish | 0 | 1 | 1 |
| Ukrainian | 1 | 0 | 1 |
| Unknown | 14 | 0 | 14 |
| Total | 120 | 153 | 273 |
First batch included MEDLINE, Cochrane, IPA, CINAHL, and HealthSTAR.
Second batch included BIOSIS and EMBASE.
| Language | Number Articles Reviewed | Reject | Accept | R1 | R2 | R3 | R4 | R5 | R6 | R7 | R8 | R9 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Japanese | 20 | 20 | 0 | 4 | 1 | 2 | 7 | 6 | ||||
| French | 17 | 15 | 2 | 2 | 1 | 1 | 10 | 1 | ||||
| German | 13 | 13 | 0 | 5 | 4 | 4 | ||||||
| Italian | 5 | 5 | 0 | 1 | 1 | 1 | 2 | |||||
| Spanish | 4 | 4 | 0 | 1 | 1 | 2 | ||||||
| Russian | 13 | 13 | 0 | 2 | 5 | 2 | 4 | |||||
| Danish | 7 | 7 | 0 | 1 | 1 | 5 | ||||||
| Polish | 8 | 8 | 0 | 1 | 1 | 6 | ||||||
| Dutch | 3 | 3 | 0 | 1 | 2 | |||||||
| Swedish | 3 | 3 | 0 | 1 | 1 | 1 | ||||||
| Norwegian | 2 | 2 | 0 | 1 | 1 | |||||||
| Romanian | 1 | 1 | 0 | 1 | ||||||||
| Hebrew | 1 | 1 | 0 | 1 | ||||||||
| Total | 97 | 95 | 2 | 20 | 2 | 16 | 11 | 37 | 9 |
Reason for Rejection:
R1=Case report/editorial/letter/clinical practice/overview/practice guidelines/consensus statements
R2=Nonhuman subjects
R3=Study condition NOT acute otitis media
R4=Not within age range of study
R5=Study population is on immunodeficiencies or craniofacial deficiencies
R6=Study design not appropriate
R7=Not addressing any key questions
R8=Duplicate of other studies in the database
R9=Data not abstractable from article, required contacting author
The screening and review of the 97 non-English articles resulted in the use of 2 articles for one of the key questions, a yield rate of two percent. The results were presented to the Technical Expert Panel during the last conference call and it was decided unanimously that the yield was too low to warrant further screening and review of the second batch of non-English articles.
The last activity in searching for articles was the identification and review of potential articles from references of studies and/or articles. The tables of contents from the second to sixth Proceedings of the International Symposium on Recent Advances in Otitis Media were screened by the literature reviewer, and a total of seven articles were retrieved for review of potential inclusion. This process yielded the inclusion of one additional article (Ostfeld, Segal, Kaufstein, et al., 1988) for Key Question 1. The screening of references of other articles, also by the literature reviewer, resulted in the retrieval and review of another 23 articles, 5 of which addressed the key questions. Among the five, articles by Townsend (1964), Thalin, Densert, Larsson, et al. (1986), and Bollag and Bollag-Albrecht (1991) were added to the articles for Key Question 1. The Thalin, Densert, Larsson, et al. (1986) article also was added to the articles for Key Question 3. The Howie and Owen (1987) study was added to the list of articles for Key Question 4a, and the article by Stickler, Rubenstein, McBean, et al. (1967) was added to the list for Key Question 4e.
Further review of articles found that the article by Cohen, de La Rocque, Boucherat, et al. (1997) in French reported results of the same study as the article by Cohen, Bingen, Varon, et al. (1997) in English except that different outcomes were reported. Based on the peer reviewers' comments on the draft evidence report, the study by van Buchem, Peeters, and van't Hof (1985) was added to the list of studies addressing the natural history question. Three Dutch and three Danish articles were reviewed with the assistance of translators; no additional articles were found for inclusion. Three of the six articles were duplicates of the English-language articles that already had been reviewed. Two of these were review articles and one was not retrievable.
Combining all the sources, including the electronic databases, searches of reference lists, and peer reviewers' comments, a total of 80 studies in 85 articles were included in answering the key questions. Of the 80 studies, 74 were randomized controlled trials and 6 were observational cohort studies; 15 addressed Key Question 1, 8 addressed Key Question 3, 35 addressed Key Question 4a, none addressed Key Question 4b, 1 each addressed Key Questions 4c and 4d, and 36 addressed Key Question 4e.
The remaining 680 articles that were not included in addressing the key questions in this evidence report are listed in the bibliography.
The criteria for the assessment of study quality were established prior to the review of articles. The criteria developed by Jadad, Moore, Carroll, et al. (1996) were used to evaluate the quality of randomized controlled trials. The Jadad score had a range of 0 to 5. For a given study, 1 point was awarded if it was randomized, 1 point if it was double-blind, and 1 point if it described withdrawals and dropouts. An extra point was awarded if the method of randomization and/or double-blinding was appropriate; conversely, one point was subtracted if the method was inappropriate. The criteria used to evaluate the quality of cohort studies and case-control studies were based on the work by the McMaster University Group (Sackett, 1981; Trout, 1981; Tugwell, 1981). The quality of cohort studies was evaluated against eight components, which included presence or absence of a clear definition of the study cohort, an early inception point, a clear pathway of patient entry, complete followup, description of dropouts, objective outcome criteria, "blind" outcome assessment, and adjustment for extraneous factors. An Article Quality Review Form (Appendix G.1) was developed. The quality of definition of AOM was evaluated using the three components of the proposed definition established by the Technical Expert Panel: middle-ear effusion, rapid onset, and signs/symptoms of inflammation. The form collected data on the study design, the key questions and subquestions being addressed, quality of definition of AOM, and quality of study. Instructions also were prepared for reviewing the quality of articles and completing the quality review form (Appendix G.2).
Quality reviews were carried out in the same manner as the screening of articles for inclusion/exclusion. Articles were not masked prior to review. Two physician reviewers independently evaluated the quality of the articles and filled out the quality review forms. The Task Order Coordinator matched the reviews of the two reviewers and resolved minor discrepancies. Conferences were held to resolve discrepancies whenever needed. During these meetings, participants determined the disposition of each article in terms of eligibility for inclusion into analysis and finalized resolutions for all items.
Of the articles eligible for inclusion in the Evidence Report, data abstraction was carried out by two physician reviewers. Data abstracted included parameters necessary to define study groups, inclusion/exclusion criteria, influencing factors, and outcome measures to be used in analysis. A sequential resolution strategy was used to match and resolve the screening and review results of the two reviewers. Telephone conferences were held among the two reviewers and the Task Order Coordinator, who was a health services researcher, to resolve discrepancies and refine instructions. The data abstraction form used is included in Appendix H.
The following procedures were used to minimize biases:
Two physician reviewers screened and reviewed titles/abstracts and full articles in every stage of the selection process to reduce selection bias. Their percentage of agreement on inclusion/exclusion was 90 percent.
Completeness of the retrieved articles was assessed by cross-checking with studies used in other meta-analyses and references listed in review articles. EndNote was used to check batches of articles added to the master list for duplication. The software checked for duplicate references by comparing author, year, title, and reference type. Following the importation of the first literature search, subsequent references were examined for duplication using this EndNote feature prior to their addition to the master list. After the master list was completed, a second check was performed to ensure there were no duplicate entries. This was done manually by scanning the master list after sorting by author and title.
Multiple sources and unpublished material identified by the expert panel and internal content experts were searched. Funnel plots -- scatter plots of sample size vs. the estimated effect size from each study -- were studied to assess the extent of publication bias. When publication bias existed, a "bite" would be taken out of the funnel plot, typically at the null effect level.
To reduce bias in the assessment of study quality, explicit preset criteria by Jadad, Moore, Carroll, et al. (1996) were used for study quality. Inter-rater reliability was used to assess the extent of bias in assessing study quality. Because of time and resource constraints, original authors were not contacted for additional information regarding study quality and reporting.
The mechanisms used to enhance consistency include the use of predesigned forms with explicit instructions and continuous and prompt resolution of discrepancies. After data collection, each of the variables collected on the data abstraction forms was entered into a Microsoft Excel spreadsheet. Cross-checking of variables for individual studies abstracted by each data collector identified discrepancies, which were then resolved by rechecking the article or consensus. The accuracy of study reviews was checked by using two data extractors who independently collected data from each article, cross-checked data entry by random sampling, and resolved any inconsistencies.
Figure 1
Project staff provided the Technical Expert Panel with a summary report from the literature review that included the number of abstracts reviewed, articles retrieved, eligible studies identified, and reasons for exclusion. Their comments on the search strategy and analysis, which were discussed in the third conference call, aided in planning supplemental analyses.
| Factor ID# | Influencing Factor | Total Rank |
|---|---|---|
| 1 | Age of child | 79.0 |
| 23 | Otitis prone | 73.0 |
| 5 | Attendance at day care center | 54.5 |
| 9 | Tobacco smoke exposure | 48.0 |
| 25 | Prior antibiotic use and when used | 36.0 |
| 30 | Presence of tube | 35.5 |
| 7 | Feeding mode -- bottle vs. breast | 25.0 |
| 22 | Middle ear effusion | 24.0 |
| 21 | Purulent otorrhea | 21.0 |
| 12 | Otalgia and severity | 19.5 |
| 41 | Cost of treatment | 15.0 |
| 36 | Setting (public, private, PPO, HMO, etc.) | 15.0 |
| 24 | Underlying viral infection | 14.0 |
| 11 | Season of the year | 14.0 |
| 29 | Atopy or allergy | 13.0 |
| 19 | Tympanic membrane inflammation | 12.0 |
| 10 | Ear infections in parents or siblings | 12.0 |
| 18 | Hearing loss | 11.0 |
| 20 | Retracted TM | 10.0 |
| 14 | Pulling of ear in an infant | 9.0 |
| 16 | Irritability | 9.0 |
| 32 | Parent/caretaker preference | 9.0 |
| 17 | Fever | 8.5 |
| 3 | Ethnicity/race | 8.0 |
| 26 | Concurrent use of non-antibiotics | 6.0 |
| 15 | Otorrhea | 5.0 |
| 2 | Gender | 4.0 |
| 4 | Presence of sibling(s) | 4.0 |
| 8 | Pacifier use | 3.0 |
| 6 | Sibling(s) in day care center | 2.0 |
| 40 | Type of method to monitor episode | 1.0 |
| 35 | Skill to diagnose | 1.0 |
| 38 | Frequency of monitoring of episode | 1.0 |
| 39 | Primary person monitoring episode | 0.0 |
| 37 | When monitoring is done during episode | 0.0 |
| 13 | Hearing deficit and severity | 0.0 |
| 33 | Parent/caretaker education | 0.0 |
| 27 | Prior hearing deficit | 0.0 |
| 34 | Type of examiner | 0.0 |
| 28 | Inability to express symptoms | 0.0 |
| 31 | Parent/caretaker availability | 0.0 |
HMO=health maintenance organization; PPO=preferred provider organization; TM=tympanic membrane.
An evidence table was prepared for each key question. Each evidence table provides a comprehensive tabular display of data abstracted from the literature, including the name of the first author, year of publication, language of study (if other than English), study design and its quality score, number of components addressed in the definition of AOM (according to the three preestablished criteria by the technical experts), when and where the study took place, inclusion and exclusion criteria, interventions compared, important influencing factors, sample sizes, outcome measures and their definitions, and study results. A total of five evidence tables were prepared and are included in the Evidence Tables section.
To address Key Question 1 on natural history, project staff analyzed data from the placebo or observational arm of randomized clinical trials, as well as data from nontrials (including prospective and retrospective single or comparative cohort studies). Incidence rates of each outcome indicator at each time point were estimated by pooling data from studies addressing the same patient population. For Key Question 3 on antibiotic use, only randomized controlled trials were used in meta-analysis.
| Question 3:The general principle agreed upon was to separate amoxicillin-clavulanate, penicillin G, penicillin V, erythromycin estolate, triple sulfonamide, and erythromycin estolate-triple sulfonamide from ampicillin/amoxicillin and each other. Penicillin G is oxidized in the stomach and is not well absorbed. Penicillin V does not cover Haemophilus Influenzaewell. Erythromycin estolate is quite different from the other antibiotics. Triple sulfonamide is no longer in common usage. | |
| Comparison | |
| Number of articles | |
| ampicillin or amoxicillin vs. placebo amoxicillin-clavulanate vs. placebo penicillin G plus sulfisoxazole vs. placebo penicillin V vs. placebo erythromycin estolate vs. placebo triple sulfonamide vs. placebo erythromycin estolate-triple sulfonamide vs. placebo | |
| 6 1 1 2 1 1 1 | |
The next major factor for consideration in the meta-analyses for each comparison was the outcome variables. A meta-analysis was performed on outcome measures that were considered clinically homogeneous, such as failure rate of antibiotics at 2-7 days. The assumption was that the 2-day failure rate reported in one study was clinically the same as the 7-day failure rate reported in another study.
Further subdivision of the articles within each comparison into subgroups for meta-analysis according to major influencing factors was considered but was not feasible due to the small number of articles. A sensitivity analysis was planned to evaluate the influence of age, otitis proneness, language, time, place, study-design quality, and appropriateness of definition of AOM. This was also not feasible due to the small number of articles in each comparison group.
| Question 4: The general principle agreed upon was to compare by individual antibiotic rather than by antibiotic class, spectrum, or pharmacokinetics. | |
| 3 0 2 1 2 5 1 5 3 2 2 1 2 1 1 1 1 1 |
| Trimethoprim-sulfamethoxazole vs. | Number of Articles |
| 1 0 0 0 3 0 1 0 0 0 0 0 0 0 0 0 |
| Question 4e:The general principle agreed upon was to compare by individual antibiotic stratified by therapy duration < 5 days vs. 5 days. | |
| 3 1 1 with two 5-day arms 1 2 2 1 1 1 1 1 2 1 1 1 1 3 2 1 1 1 5 2 1 3 |
The DerSimonian and Laird random effects model (DerSimonian and Laird, 1986) was used to pool effect sizes across studies. This method produces a summary measure that is a weighted mean. It weights each study's measure by the inverse of the sum of the within-study variance and the between-study variance. This approach allows both sampling variation and between-study heterogeneity to affect the pooled estimate. Among the three effect measures -- rate difference, relative risk, and odds ratio -- the Technical Expert Panel and the project staff chose as most suitable the rate difference and its 95 percent confidence limits, which are presented both numerically and graphically. It should be noted that the absolute rate difference was used rather than the relative rate difference to measure the effect size throughout the report.
In addition to the pooled estimate, we report the Q statistic and p-value for the Chi-squared test of heterogeneity, which tests the null hypothesis that the individual study results are homogeneous (Laird and Mosteller, 1990). Because the test is known to lack power to detect heterogeneity, we protected against spurious conclusions resulting from combining clinically heterogeneous patients or treatments in two ways, regardless of the outcome of the Chi-squared test of heterogeneity. First was the use of random effects estimates that incorporate some between-study variance even if the Chi-squared test does not reject. Second, subgroup analyses and sensitivity analyses were planned to assess the impact of possible heterogeneity on the conclusions, but these were not feasible because of the small number of studies in each comparison group.
When necessary, we had planned to conduct meta-regression analysis for comparisons where multiple arm studies where used more than once. However, we did not have any multiple-arm studies that were used more than once in our comparisons using the same outcome indicator.
We also had planned to conduct a power analysis for those comparisons where the rate difference was 10 percent or higher but did not reach statistical significance. However, none of the comparisons that did not reach statistical significance was 10 percent or higher; thus, a power analysis was not performed.
To prepare for a meta-analysis for each comparison, data were abstracted from the evidence table (one meta-analysis for each outcome measure). The following data elements were entered in an SAS program to be converted into an SAS data set: the study ID number, author, year of publication, number of adverse outcomes in the experimental group, total number of patients in the experimental group, number of adverse outcomes in the control group, and total number of patients in the control group. An SAS macro software program that was developed by RAND statistical staff was used to perform all meta-analyses; the beta-test version of the software package "MetaGraphs" (1998, Belmont Research, Inc., 84 Sherman Street, Cambridge, MA 02140) was used for the graphing.
The following statistics were generated from the SAS macro program: (a) study-level statistics (incidence rate, relative risk, risk difference, number needed to treat [NNT], odds ratio, and their 95 percent CI); (b) crude estimates and their 95 percent CI for all studies combined; (c) fixed effects estimates and their 95 percent CI for all studies combined; (d) random effects estimates and their 95 percent CI based on the DerSimonian and Laird method for pooling study results and the Chi-squared test of homogeneity; and (e) weight for each study for both fixed effects model and random effects model in calculation of risk difference and relative risk.
To use MetaGraphs for graphing, the data were entered into ASCII files using the UltraEdit-32 software. Funnel plots were produced for the purpose of screening possible publication bias and the shrinkage plots were generated to display the effect size of each study and compare it against the overall model estimate, together with their 95 percent confidence limits.
Of the 80 studies used in the evidence report, 40 (50 percent) were published in the 1990s, 25 (31 percent) in the 1980s, 8 (10 percent) in the 1970s, and 7 (9 percent) in the 1960s. The earliest article was published in 1964 and the latest in 1998. Forty-one studies (51 percent) were conducted in the United States. Six studies did not specify either a lower or upper age limit, although they all stated that the subjects were children (Bollag and Bollag-Albrecht, 1991; Froom, Culpepper, Grob, et al., 1990; Howie and Ploussard, 1972; Laxdal, Merida, and Jones, 1970; Tilyard, Dovey, and Walker, 1997; and Townsend, 1964). Of the six studies, four were observational cohort studies and two were randomized controlled trials. All addressed Key Questions 1 and 3. The otitis-prone status of the study population, the other influencing factor considered important by the Technical Expert Panel, was not reported in 64 percent (51/80) of the studies.
Of the 80 studies, 74 were randomized controlled trials. Their study-design quality was evaluated using the Jadad score (Jadad, Moore, Carroll, et al., 1996). Of the 74 studies, 6 (8 percent) had the highest score (5 on the Jadad scale); 12 (16 percent) scored 4; 21 (28 percent) scored 3; 26 (35 percent) scored 2; 8 (11 percent) scored 1; and 1 (1 percent) scored 0. Project staff evaluated the study-design quality of the six observational cohort studies by the presence or absence of eight components of study quality. Of the six studies, two studies addressed four of the eight components, one study addressed three, two studies addressed two, and one study addressed one. Of the 74 randomized controlled studies, 30 (41 percent) mentioned double-blinding, 52 (70 percent) described the characteristics of the dropouts, 28 (38 percent) used appropriate randomization methods, and 17 (23 percent) used appropriate blinding strategies.
For definition of AOM, none of the 80 studies used all three components (middle-ear effusion, rapid onset, and signs/symptoms of inflammation) of the proposed definition established by the Technical Expert Panel; 18 (22.5 percent) used two components; 34 (42.5 percent) used only one component; and 28 (35 percent) used none. Of the 80 studies, 42 (52.5 percent) included the middle ear effusion component, 2 (2.5 percent) included the rapid onset component, and 26 (32.5 percent) included the signs/symptoms of inflammation component.
With respect to the Technical Expert Panel's criterion that an "initial" episode of AOM be separated by at least 4 weeks from the end of an antibiotic course of treatment for the last episode of AOM, 21 of 74 (28 percent) randomized controlled trials and 6 of 6 (100 percent) cohort studies did not address this issue. Many of the other studies also did not address this issue: 9 of the 15 (60 percent) studies on natural history; 3 of the 9 (33 percent) studies on the effects of antibiotics on AOM; 12 of the 34 (35 percent) studies on ampicillin or amoxicillin or trimethoprim-sulfamethoxazole vs. other antibiotic, the single study on high-dose vs. standard-dose amoxicillin; and 5 of the 36 (14 percent) studies on short-duration vs. long-duration. Of the studies that addressed duration of the initial AOM episode, 17 met the criterion of 4 weeks or longer. None required that the last episode of AOM be documented as having cleared.
In the letter to the 11 organizations requesting nominations for technical experts, nominations for peer reviewers also was requested. As of November 3, 1998, a total of 21 nominations for the Peer Review Panel were received. On November 16, 1998, a letter was mailed to the Ambulatory Pediatric Association (APA) and to the American Association of Health Plans (AAHP) requesting nomination of peer reviewers. Nine additional experts expressed interest to serve on the Peer Review Panel and submitted their curriculum vitae.
Experts in systematic reviews and meta-analysis were selected from a pool of experts maintained by the Southern California Evidence-based Practice Center who were not involved with this project.
| Technical Expert | Area of Expertise | Affiliation/Location |
|---|---|---|
| Alfred O. Berg, M.D., M.P.H. | Family Medicine | University of Washington, Seattle, WA |
| Larry Culpepper, M.D.,M.P.H. | Family Medicine | Boston Medical Center, Boston, MA |
| Robert Ruben, M.D. | Otolaryngology | Montefiore Medical Center, Bronx, NY |
| Stanford T. Shulman, M.D. | Pediatrics, Infectious Disease | Children's Memorial Hospital, Chicago |
| Elizabeth Susan Hodgson, M.D. | Pediatrics, Ambulatory | St. Peter's Pediatric Faculty Group PracticeNew Brunswick, NJ |
| Jerome Klein, M.D. | Pediatrics, Infectious Disease | Boston Medical Center, Boston, MA |
| Lisa L. Hunter Ph.D. | Audiology | University of Minnesota, Minneapolis, MN |
| Terese Finitzo, Ph.D. | Audiology | Dallas, TX |
| Carol Rudy, M.S.N.,C.P.N.P. | Nurse Practitioner | Spokane, WA |
| Tracy Lieu, M.D. | Health Plan | Harvard Pilgrim Health Care, Boston, MA |
| Michael Siegel, M.D. | Health Plan | Prudential Health Care Plan, CA |
| Fran Goldfarb, M.A. | Consumer | Family Voices, Los Angeles, CA |
| Mark P. Haggard, Ph.D. | Epidemiology and Outcomes Methods | Institute for Hearing Research, UK |
| Anne G.M. Schilder, M.D., Ph.D. | Otolaryngology | University Medical Center Utrecht, TheNetherlands |
| Hanan S. Bell, Ph.D. | Methodology reviewer | Seattle, WA |
| Vic Hasselblad, Ph.D. | Meta-analysis reviewer | Duke University, Durham, NC |
| Katherine Harris, Ph.D. | Cost-analysis reviewer | RAND, Santa Monica, CA |
| Lynne Haverkos, M.D. | Government reviewer | NICHD |
| Robin Yurk, M.D., M.P.H. | Consumer | The Foundation for Accountability, Portland, OR |
| Peer Reviewer #20 | Otolaryngologist | |
| Peer Reviewer #21 | Nurse practitioner | |
| Peer Reviewer #22 | Pediatric pharmacologist | |
| Peer Reviewer #23 | Pediatrician | |
| Peer Reviewer #23 | Methodology reviewer |
| Enclosed is a draft evidence report on the management of acute otitis media. You may make your comments either directly on the draft evidence report, or on a separate sheet of paper. If you choose to record your comments on a separate piece of paper, please use the page and paragraph number to identify to which part of the report your comments pertain. We ask that you consider the following questions while you read this report. We realized that some of the questions may not pertain to your area of expertise. Please feel free to comment only on those that you feel most suited to answer. |
| 1. Overall evaluation Is it clear what we did? You may agree or disagree with our methods, findings, or conclusions, but you should be able to understand what we did in order to produce this report. |
| 2. Methodology Are the methods we used appropriate: (a) for identifying the key questions of interest from the panel of technical experts? (b) for searching and reviewing the identified literature? (c) for synthesizing the literature? |
| 3. Evidence (a) Did we miss any crucial pieces of information in our literature search? (b) Does the evidence support the conclusions? |
| 4. Utility Would you find this information to be useful if you had to develop clinical practice guidelines or medical review criteria for management of acute otitis media in children? |
To understand the true effect of an intervention on a clinical condition such as AOM, the natural history of that condition without intervention must be known. The timing of processes and intermediate outcomes, as well as the ultimate outcomes of acute otitis media (AOM) without intervention, must be known. Also important are influencing factors, either genetic, familial, cultural, or environmental, that may be difficult to control and that may affect the outcomes of AOM apart from, in addition to, or in interaction with the interventions of interest. The Technical Expert Panel decided to concentrate on age and otitis-prone state as such influencing factors to analyze. To properly estimate the marginal effects of an intervention on the outcomes of AOM, the natural history of AOM without intervention should be clearly understood.
The question we asked was: During an episode of uncomplicated AOM that is initially managed without any active intervention (pharmacologic or surgical) other than topical or systemic medications (that do not contain antibiotics) given for symptomatic relief (e. g., analgesics, antipyretics, antihistamines, decongestants, ear or nose drops), what proportion of children have the outcomes delineated in the Scope of the Evidence Report (Appendix E.4). To what degree are the above outcomes attributable to the influencing factors delineated in the Scope of the Evidence Report (Appendix E.4).
Rosenfeld (1999a) assessed the natural history question in a previous information synthesis. As in the present analysis, Rosenfeld (1999a) evaluated children from epidemiologic studies, untreated control groups in randomized clinical trials, and cohort studies with an untreated group. Rosenfeld (1999a) assessed the same set of studies as in the present evidence-based analysis except for the inclusion of Fry (1958) and the absence of Tilyard, Dovey, and Walker (1997). We excluded Fry (1958) from our analysis because we could not extract the data on children from the data on adults in that study. Data were then pooled to calculate outcome estimates. Rosenfeld (1999a) estimated that 59 percent (3 studies; 315 children; 95 percent confidence limits, 53 percent and 65 percent) of children had relief of pain and fever within 24 hours of diagnosis. We note that one study used in this estimate (Burke, Bain, Robinson, et al., 1991) reported on resolution of pain and fever separately, and another study (Thalin, Densert, Larsson, et al., 1986) reported on pain and ear discharge, but not fever. To include the data in the estimate, an assumption must be made that those without pain did not have fever. Rosenfeld (1999a) estimated that 87 percent (5 studies; 808 children; 95 percent confidence limits, 84 percent and 89 percent) had relief of pain and fever within 2-3 days. Data from the Thalin, Densert, Larsson, et al. (1986) study was used in this estimate. Relief of pain and fever at 4-7 days was estimated to be 88 percent (5 studies; 503 children; 95 percent confidence limits, 85 percent and 91 percent). Again, data from the estimates in two studies -- Burke, Bain, Robinson, et al. (1991) and Thalin, Densert, Larsson, et al. (1986) -- were included in this estimate.
Finally, clinical resolution within 7-14 days of diagnosis was estimated at 73 percent (4 studies; 270 children; 95 percent confidence limits, 65 percent and 78 percent) based on the absence of all presenting signs and symptoms except middle ear effusion. The numerator used from one study (Halsted, Lepow, Balassanian, et al., 1968) appears to include success as judged by clinical or bacteriologic failure rather than clinical failure alone. In another study (Mygind, Meistrup-Larsen, Thomsen, et al., 1981) used in this estimate, the denominator is not clear from the report, and the initial denominator was used. Finally, Rosenfeld (1999a) found two cases of acute mastoiditis in 1,802 patients managed without antibiotics out of 2,368 patients, predominantly children, in six observational studies. (Although we mention some concerns about the data in these estimates, we also acknowledge that the direction and general magnitude of the estimates would not change with exclusion of that data. These same concerns apply to the use of these data in Rosenfeld (1999b), which is mentioned in the previous meta-analyses section Antibiotics vs. No Antibiotics in this chapter.)
As proxies for natural history, we used the observational arm of cohort studies and the observational or placebo arm of randomized controlled trials of AOM. The treatment arm of such trials could be of any modality, antibiotic, myringotomy, etc., as long as the control arm consisted solely of observation or placebo.
With respect to the age of the subjects, of the nine randomized controlled trials, three studies had no children under 2 years of age (Burke, Bain, Robinson, et al, 1991; Thalin, Densert, Larsson, et al., 1986; van Buchem, Dunk, and van't Hof, 1981), one had about one-fifth of the study population under 2 years of age (Appelman, Claessen, Touw-Otten, et al., 1991), two had approximately one-half of their study populations under 2 years of age (Kaleida, Casselbrant, Rockette, et al., 1991; Laxdal, Merida, and Jones, 1970), and two had at least three-fourths of the study population under 2 years of age (Halsted, Lepow, Balassanian, et al., 1968; Howie and Ploussard, 1972). Mygind, Meistrup-Larsen, Thomsen, et al. (1981) reported a mean age of 3.9 years for their study population but did not stratify any further. Of the cohort studies, one study had almost 90 percent of the total 2 years of age or younger (Ostfeld, Segal, Kaufstein, et al., 1988) and two studies had more than one-fourth of their total subjects younger than 30 months of age (Froom, Culpepper, Grob, et al., 1990; Tilyard, Dovey, and Walker, 1997). In the Thalin, Densert, Larsson, et al. (1986) study, all patients were older than 2 years of age. One study reported mean ages for their subjects as a whole, but not specifically for the groups not treated with antibiotics (Bollag and Bollag-Albrecht, 1991). Another study did not report on the ages of the patients (Townsend, 1964).
With regard to the otitis-prone state, four of the nine studies described their study populations with respect to this influencing factor. Appelman, Claessen, Touw-Otten, et al. (1991) reported that 12 percent of their study population had three or more episodes of AOM prior to the study; Burke, Bain, Robinson, et al. (1991) reported 47 percent; and Kaleida, Casselbrant, Rockette, et al. (1991), 21 percent. Thalin, Densert, Larsson, et al. (1986) reported that 27 percent of their patients had more than 10 episodes of AOM, and 23 percent of their patients had no prior episodes of AOM. None of the cohort studies referred to their subjects' past experiences with AOM.
| Author/Year | Outcome(s) Measured 1 | Time(s) Measured |
|---|---|---|
| Randomized Controlled Trials | ||
| Halsted/1968 | early improvement | 24-72 hours |
| resolved | 14-18 days | |
| recurrence | 1 year | |
| Laxdal/1970 | excellent | 7 days |
| good | 14 days | |
| fair | 21 days | |
| poor | 21 days | |
| failure | 7 days | |
| Howie/1972 | improvement/failure | 2-7 days |
| fever | 2-7 days | |
| nonsterile exduate | 2-7 days | |
| Mygind/1981 | satisfactory course of acute phase | 7 days |
| symptom free | 2 days | |
| otorrhea | >5 days | |
| middle ear effusion | 1 week, 1 month, 3 months | |
| contralateral otitis media | 1 week | |
| relapse | 1 week, 1-3 months | |
| van Buchem/1981 | pain | >24 hours, >7 days |
| abnormal otoscopy | >7 days, >14 days | |
| otorrhea | >24 hours, >7 days | |
| relapse | 6 months | |
| Thalin/1986 | complete resolution | 30 days |
| failure | 30 days | |
| relapse | 30 days | |
| Appelman/1991 | irregular course | >3 days |
| tympanometry | 1 month | |
| Burke/1991 | failure | 7 days |
| pain | 2 days, 5-7 days | |
| fever | 2 days, 5-7 days | |
| abnormal otoscopy | >7 days | |
| middle ear effusion | 1 month, 3 months | |
| recurrence | 1 year | |
| Kaleida/1991 | treatment failure | 24-48 hours, 1 year |
| middle ear effusion | 2 weeks, 6 weeks | |
| recurrence | 2-6 weeks | |
| Cohort Studies | ||
| Townsend/1964 | complication | 1 year |
| Ostfeld/1988 | otorrhea | 24 months |
| chronic middle ear effusion | 24 months | |
| recurrence | 24 months | |
| pressure equalizing tube placement | 24 months | |
| mastoiditis | 24 months | |
| Froom/1990 | recovery | 2 months |
| Bollag/1991 | mastoiditis | 2 months |
| hearing deficit | 2 weeks | |
| Tilyard/1997 | failure | 30 days |
| van Buchem/1985 | cure | 14 days |
| severe course | 3-4 days | |
| persistent discharge | 14 days | |
| Author/Year | Term(s) | Definition(s) | Time Measured |
|---|---|---|---|
| SUCCESS | |||
| Randomized Controlled Trials | |||
| Halsted/1968 | early improvement | decreased symptoms | 24-72 hours |
| resolved | asymptomatic and normal tympanic membrane appearance | 14-18 days | |
| Laxdal/1970 | excellent | no evidence of middle ear inflammation | 7 days |
| good | signs of otitis media resolved | 14 days | |
| gair | signs of otitis media resolved | 21 days | |
| Howie/1972 | improvement | absence of exudate | 2-7 days |
| Mygind/1981 | satisfactory course of acute phase | (1) not crying from pain after 1day (2) no analgesics after 1day (3) no otitis symptoms after 2days (4) otorrhea <6 days (5) no contralateral otitis first week | 1 week |
| Thalin/1986 | complete resolution | not clear if refers to "satisfactory" defined as normal otomicroscopy and normal audiogram and/or tympanogram | 30 days |
| Cohort Studies | |||
| Townsend/1964 | recovery | (1) tympanic membrane normal (2) pneumatic otoscopy normal (3) audiogram and hearing per parents and teacher normal | 1 year |
| Van Buchem/1985 | cure | not severe course and without persistent discharge | 14 days |
| Froom/1990 | recovery | based on pain, ear drainage, hearing problem, or other | 2 months |
| FAILURE | |||
| Randomized Controlled Trials | |||
| Laxdal/1970 | poor | persistent signs of minimal infection | 21 days |
| failure | no improvement or deterioration | 7 days | |
| Howie/1972 | failure | presence of xudates | 2-7 days |
| Thalin/1986 | failure | Remaining nonnegligible symptoms (pain, fever, etc.) or insufficient resolution of infectious signs during the medical treatment period | 7 days |
| Appelman/1991 | irregular course | otalgia or > 38 degrees Centigrade | >3 days |
| Burke/1991 | failure | second-line antibiotic required, presumably due to nonresolution or recurrence of symptoms | 1 week |
| Kaleida/1991 | initial treatment failure | "severe" criterion present >24 hours or >38 degrees Centigrade oral or 38.5 degrees Centigrade rectal or >6 otalgia score | 24-48 hours |
| ultimate treatment failure | cumulative >180 days middle ear effusion in same ear or > four severe AOM episodes or > five any AOM or new otitis media with effusion within 6 months or fourth myringotomy in 6 months or fifth in 12 months or suppurative complication or cholesteatoma or an allergic reaction to penicillin | 1 year | |
| Cohort Studies | |||
| Townsend/1964 | complication | purulent progression of disease or serous otitis media | 1 year |
| Van Buchem/1985 | Severe course | Persistent high temperature or severe pain | 3-4 days |
| persistent discharge | Persistent discharge | 14 days | |
| Froom/1990 | no or uncertain recovery | based on pain, ear drainage, hearing problem, or other | 2 months |
| Tilyard/1997 | failure | return <10 days with same problem or change antibiotic within 30 days | 30 days |
| Author/Year | Time Measured/Influencing Factor | Failure Rate |
|---|---|---|
| Randomized Controlled Trials | ||
| Halsted/1968 | 24-72 hours | 7/27 (26%) |
| 14-18 days | 0/21 (0%) | |
| Laxdal/1970 | 7 days | 18/48 (38%) |
| 0-3 years old | 46% (denominator not reported) | |
| 3-6 years old | 38% denominator not reported) | |
| 6-9 years old | 25% (denominator not reported) | |
| 9-14 years old | 0% (denominator not reported) | |
| Howie/1972 | 2-7 days | 92/116 (79%) |
| Mygind/1981 | 7 days | 31% (denominator not reported) |
| Thalin/1986 | 7 days | 12 (count only, denominator unknown) |
| Appelman/1991 | >3 days | 10/54 (18%) |
| <2 years old | 7/12 (58%) | |
| >2 years old | 3/42 (7%) | |
| Burke/1991 | 7 days | 17/118 (14%) |
| 3-5 years old | 10/66 (15%) | |
| 6-9 years old | 7/52 (13%) | |
| <2 prior AOM 2 | 6/55 (11%) | |
| >2 prior AOM | 7/48 (15%) | |
| Kaleida/1991 | 24-48 hours | 38/492 (7.7%) |
| <2 years age | 25/254 (9.8%) | |
| >2 years age | 13/238 (5.5%) | |
| 1 year | 46/170 (27.1%) | |
| <2 years age | 30/82 (36.6%) | |
| >2 years age | 16/88 (18.2%) | |
| Cohort Studies | ||
| Townsend/1964 | 1 year | 11/189 (5.8%) |
| Van Buchem/1985 | 14 days | 20/465 (4.3%) |
| Froom/1990 | 2 months | 40/4 19 (9.5%) |
| 0-12 months old | 5/39 (12.8%) | |
| 13 30 months old | 7/69 (10.1%) | |
| >31 months old | 28/311 (9.0%) | |
| Tilyard/1997 | 1 month | 8/74 (10.8%) |
| <2 years old | 4/29 (14%) | |
| 2 5 years old | 4/22 (18%) | |
| 6-15 years old | 0/12 (0%) | |
| >15 years old | 0/11 (0%) | |
AOM=acute otitis media
Balassanian, et al. (1968). Appelman, Claessen, Touw-Otten, et al. (1991) reported a failure rate of 18 percent measured after 3 days. Failure monitored at 7 days was reported as 8 percent by Thalin, Densert, Larsson, et al. (1986), 14 percent by Burke, Bain, Robinson, et al. (1991), and 38 percent by Laxdal, Merida, and Jones (1970). An unsatisfactory clinical course of the acute phase (7 days) was reported for 31 percent of the placebo group by Mygind, Meistrup-Larsen, Thomsen, et al. (1981). Thalin, Densert, Larsson, et al. (1986) reported 12 subjects in their placebo group failing therapy at 7 days but did not specify a denominator. According to the definition of failure by Howie and Ploussard (1972) as the presence of middle ear exudate at 2-7 days, that group reported a rate of failure of 79 percent in the placebo group and 57 percent in the antibiotic group. Failure in the placebo group at 14-18 days was 0 percent (Halsted, Lepow, Balassanian, et al. 1968) and failure for the placebo group at 1 year was 27.1 percent (Kaleida, Casselbrant, Rockette, et al. 1991). The cohort study (Tilyard, Dovey, and Walker 1997) reported a failure rate of 10.8 percent in their group not treated with antibiotics at 1-month measurement, (Froom, Culpepper, Grob, et al. 1990), a failure rate of 9.5 percent at 2-month measurement, and a failure rate of 5.8 percent at 1-year measurement (Townsend 1964).
| Author/Year | Time Measured/Influencing Factor | Number of patients with Symptom |
|---|---|---|
| Randomized Controlled Trials | ||
| Pain | ||
| van Buchem/1981 | >24 hours | 11/49 (28%) |
| >7 days | 4/38 (10%) | |
| Burke/1991 | 2 days | 56/117 (48%) |
| 5-7 days | 29/114 (25%) | |
| Fever | ||
| Howie/1972 | 2-7 days | 0/116 (0%) |
| Burke/1991 | 2 days | 19/93 (20%) |
| 5-7 days | 8/70 (11%) | |
| Pain or Fever | ||
| Mygind/1981 | 2 days | 38% (denominator not reported) |
| van Buchem/1981 | >24 hours | 11/40 (28%) |
| >7 days | 4/38 (10%) | |
| Thalin/1986 | 7 days | 12 (count only, denominator unknown) |
| Appelman/1991 | >3 days | 10/54 (18%) |
| <2 years old | 7/12 (58%) | |
| >2 years old | 3/42 (7%) | |
| Kaleida/1991 | 24-48 hours | 38/492 (7.7%) |
| <2 years old | 25/254 (9.8%) | |
| >2 years old | 13/238 (5.5%) | |
| Author/Year | Time Measured/Influencing Factor | Number of Patientst with Symptom |
|---|---|---|
| Randomized Controlled Trials | ||
| Howie/1972 | 2-7 days | 92/116 (79%) |
| Mygind/1981 | 1 week | 50% (denominator not reported) |
| 1 month | 32% (denominator not reported) | |
| 3 months | 24% (denominator not reported) | |
| Thalin/1985 | 30 days | 41% (denominator not reported) |
| Burke/1991 | 1 month | 41/116 (35%) |
| 3 months | 31/111 (28%) | |
| Kaleida/1991 | 2 weeks | 255/408 (63%) |
| <2 years old | 143/209 (68%) | |
| >2 years old | 112/1 19 (56%) | |
| 6 weeks | 169/328 (52%) | |
| <2 years old | 99/175 (57%) | |
| >2 years old | 70/153 (46%) | |
| Cohort Study | ||
| Ostfeld/1987 | 24 months | 42% (denominator not reported) |
| Article/Year | Time of Study; Locale | Antibiotic | Age | Otitis-Prone Status | Denominator | Mastoiditis | Other Suppurative Complication |
|---|---|---|---|---|---|---|---|
| Cohort Studies 2 | |||||||
| Bollag/1991 | 2/86-2/88; Switzerland | none | mean 51.0 m 3 (SEM 35.9 m) | not addressed | 153 | 0 | 0 (meningitis) |
| 3/88-2/89; Switzerland | none | mean 68.6 m 3 (SEM 38.9 m) | not addressed | 56 | 0 | 0(meningitis) | |
| Ostfeld/1988 | 3/81-2/83; Locale not noted | none | <6 m=110 4 pts 7-12 m=166pts 13-24m=75pts >24 m=46pts | not addressed | 397 | 2 | 0 (meningitis) |
| antibiotics "for associated medical conditions" | <6 m=87 4 pts 7-12 m=116pts 13-24 m=67pts >24 m=26pts | not addressed | 196 | 3 | 0 (meningitis) | ||
| Randomized Controlled Studies | |||||||
| Burke/1991 | 10/86-4/87, 10/87-4/88, 10/88-4/89; Southampton, Bristol, and Portsmouth, England | placebo | 3-5 y=66pts 6-9 y=52pts | previous AOM: 0-2 55 >2 48 | 111 5 | 0 | 0 (meningitis) |
| 10/86-4/87, 10/87-4/88, 10/88-4/89; Southampton, Bristol, and Portsmouth, England | amoxicillin | >3 y < 10 y | not specified for this group 6 | 110 5 | 0 | 0 (meningitis) | |
| Kaleida/1991 | 5/81-8/85; Pittsburgh, U.S.A. | placebo | <2 y=136pts 2-5 y=107pts 6-12 y=30pts | previous AOM in last year: 0/98 1-2/120 >2/55 | 170 from the nonsevere group | 0 7 | 0 7 |
| 5/81-8/85; Pittsburgh, U.S.A. | amoxicillin | <2 y=133pts 2-5 y=108pts 6-12 y=22pts | previous AOM in last year: 0 105 1-2 100 >2 58 | 169 from the nonsevere group | 1 7 | 0 8 | |
| Thalin/1986 | 7/84-6/85; Halstad, Sweden | placebo | 2-15 y 9 | not specified for this group 10 | 159 11 | 0 | 0 |
| 7/84-6/85; Halstad, Sweden | penicillin VK | 2-15 y 9 | not specified for this roup 10 | 158 11 | 0 | 0 | |
| van Buchem/1981 | 1/79-3/79; Tilburg, The Netherlands | placebo | 2-12 y 12 | not addressed | 40 13 | 0 | 0 |
| 1/79-3/79; Tilburg, The Netherlands | amoxicillin | 2-12 y 12 | not addressed | 47 13 | 0 | 0 | |
| Mygind/1981 | 11/77-4/78; Copenhagen, Denmark | placebo | mean 4.1 y | not addressed | 77 | 0 | 0 |
| 11/77-4/78; Copenhagen, Denmark | penicillin VK | mean 3.7 y | not addressed | 72 14 | 1 14 | 0 | |
| Laxdal/1970 | 1/66-9/68; Saskatchewan, Canada | none | <14 y 15 | not addressed | 48 | 0 16 | 0 16 |
| 1/66-9/68; Saskatchewan, Canada | penicillin G or ampicillin | <14 y 15 | not addressed | 94 | 0 16 | 0 16 | |
Mixed-treatment arms are not reported in this table.
In addition to these two cohort studies, van Buchem, Peeters, van't Hof (1985) mention two cases of mastoiditis in a 17-month study period for which the authors estimate a denominator of 4,860 children with AOM based on a 3-month convenience sample.
Lower age limit was not specified.
This is the denominator for the 3-month follow up.
Of the total group (placebo plus amoxicillin), 53 percent of patients had 0-2 previous episodes of AOM, and 47 percent had >2 previous episodes of AOM.
These counts are by implication because no episodes of mastoiditis were reported in the "Complications" section of "RESULTS" nor any other suppurative complications in the placebo group.
It is not clear from the article if this child with unilateral paresis of the marginal mandibular nerve was in the nonsevere or severe group. She was on antimicrobial treatment.
Of the total group (placebo and penicillin VK), 51 episodes of AOM involved children 2 years old, and 266 episodes of AOM involved older children.
Of the total group (placebo and penicillin VK), 23 percent of the children had their first episode of AOM and as many as 27 percent had suffered from AOM more than 10 times.
The article does not indicate the denominators for serious complications. These were the denominators at the start of the study.
Of the total group (placebo and amoxicillin), 18 were 2 years old, and 153 were older.
Reference to "Complications" is reported for an observation period of 2 years, but a 2-year denominator is not reported. These were the denominators at the start of the study.
Mastoiditis occurred sometime after the "immediate period after treatment", so the choice of denominator was unclear. The denominator "72" was at the start of study. Denominators at 1 month and 3 months were not reported by study group.
Lower-age limit was not specified. Of the total group (no antibiotic and antibiotic), 50 percent were < 3 years old, 25 percent were 3-6 years old, 18 percent were 6-9 years old, and 7 percent were > 9 years old.
These counts are by implication because authors report "no serious complications."
The following articles of no antibiotic treatment of AOM do not report mastoiditis or suppurative complications as outcomes:
1. Cohort studies: Froom, Culpepper, Grob, et al. (1990); Tilyard, Dovey, and Walker (1997); Townsend (1964) [The author mentions 1 case of mastoiditis in a child in the symptomatic treatment plus myringotomy group that included 2 cases but does not comment on the presence or absence of suppurative complications in the other treatment groups, including the 218 cases that were treated symptomatically.]
2. Randomized controlled studies: Appelman, Claessen, Touw-Otten, et al. (1991); Halsted, Lepow, Balassanian, et al. (1968); Howie and Ploussard (1972)
Despite these cautions, it appears that placebo or no antibiotic treatment in the setting of studies with close followup of patients is not necessarily associated with a high risk of mastoiditis or suppurative complications.
The natural history results must be considered in light of the role of antibiotic intervention in the "no antibiotic" treatment groups. Although the placebo or observational groups in all the studies were not treated initially with antibiotics, all nine of the randomized controlled trials and two of the six cohort studies mention clinical circumstances that would allow the investigator to administer antibiotics to children in the placebo or observational groups. Persistent symptoms or complications were common reasons for giving antibiotics to children in the placebo or observational groups. The majority of these studies had close followup of children, which allowed for timely clinical assessment. Most of the studies did not state explicitly how many children received antibiotics from these groups; however, in view of the criteria given for administering antibiotics, the numbers were probably small. (The only exception would be the Howie and Ploussard (1972) study where the investigators decided arbitrarily to give a majority of children in the placebo group amoxicillin starting at 2-5 days.) In most cases, the children in the placebo or observational group who received antibiotics were not removed from the study; in any case, the administration of antibiotics would not have had an effect on the early outcomes. This discussion also applies to the results on antibiotics vs. no antibiotics.
We asked the following: Are antibiotics effective (in terms of statistical significance and magnitude of absolute clinical benefit above and beyond placebo/observational/no treatment/natural history) in the initial treatment of uncomplicated AOM with respect to the outcomes delineated in the Scope of the Evidence Report (Appendix E.4)? When antibiotics are used in the initial treatment of uncomplicated AOM, which of the influencing factors delineated in the Scope of the Evidence Report (Appendix E.4) are associated with better outcomes when compared with placebo/observational/no treatment/natural history?
Before asking which antibiotics are effective in treating AOM, we first ask if antibiotics have any marginal benefit in the treatment of AOM compared with natural history. In the scientific setting, the randomized controlled trial is the ideal method to answer this question by comparing the effect of antibiotics to that of placebo or observational treatment as proxies for natural history.
Del Mar, Glasziou, and Hayem (1997); Rosenfeld, Vertrees, Carr, et al. (1994); and Rosenfeld (1999b) have conducted quantitative syntheses assessing the marginal benefit of antibiotics in the treatment of AOM compared with placebo or observational therapy. Del Mar, Glasziou, and Hayem (1997) and Rosenfeld, Vertrees, Carr, et al. (1994) meet the validity criteria for systematic reviews of Oxman, Cook, and Guyatt (1994). Rosenfeld's (1999b) methodology is not described in detail, but it follows the guidelines of Oxman, Cook, and Guyatt (1994). A quantitative synthesis by Damoiseaux, van Balen, Hoes, et al. (1998) attempted to evaluate the effectiveness of antibiotic treatment of AOM in children younger than 2 years old, but examination of the report reveals that data from one of the four studies (Halsted, Lepow, Balassanian, et al., 1968) included children older than 2 years; in another study (Englehard, Cohen, Strauss, et al., 1989), the placebo group is treated with myringotomy as well. For these reasons, the results of the Damoiseaux, van Balen, Hoes, et al. (1998) quantitative synthesis will not be reported.
| Title | Literature Sources | Paper Trail | Questions | Results | Author Conclusions/Reviewer Comments |
|---|---|---|---|---|---|
| Title | Literature Sources | Paper Trail | Questions | Results | Author Conclusions/Reviewer Comments |
| Are antibiotics indicated as initial treatment for children with acute otitis media? A meta-analysis. | Index Medicus manual search, 1958- 1965; MEDLINE, 1966-8/94; Current Contents, 1966-8/94; References of all retrieved articles; Not noted if non-English language articles were included. | Does not explain in detail the process of article selection and does not provide much descriptive information about the articles | 1). Do antibiotics in the treatment of AOM affect the resolution of pain: (a) at 24 hours? (b) at 2-7 days? 2). Do antibiotics in the treatment of AOM affect the incidence of tympanic membrane perforation? 3). Do antibiotics in the treatment of AOM affect the incidence of vomiting, diarrhea, or rash? 4). Do antibiotics in the treatment of AOM affect the resolution of deafness: (a) at 1 month? (b) at 3 months? 5). Do antibiotics in the treatment of AOM affect the incidence of contralteral AOM? 6). Do antibiotics in the treatment of AOM affect the incidence of recurrent AOM? | 1. (a) no, 124/318 vs. 125/315 1. (b) yes, less pain, 90/929 vs. 131/914, RD 41% of who still had pain at 24 hours (14%-60%) 2) possibly fewer perforations but not statistically significant, 7/190 vs. 14/191 3) yes, more vomiting, diarrhea, or rash, 57/345 vs. 38/353, OR 1.97(1. 19-3.25) 4) a) no, 64/183 vs. 66/193 4) b) possibly fewer deaf but not statistically significant, 38/182 vs. 49/188 5) yes, less contralateral AOM, 35/329 vs. 56/337, RD 43% (9%-64%) 6) no, 187/864 vs. 175/804 | "Many doctors and their patients may be disinclined to use antibiotics at first presentation of otitis media for so little benefit. Others may regard any potential benefit as worth the inconvenience of purchasing and administering the drugs and the risk of their (usually) minor complications." "...17 children must be treated at first presentation to prevent one child experiencing pain after 2-7 days..." (Pain resolves spontaneously within 24 hours in 60% and within 2-7 days in 86% without antibiotics.) |
| (Results are graphically displayed as ORs and in tabular counts with associated statistics, but the actual Ors and confidence intervals are not all reported. Two results are reported as RDs.) | The authors acknowledge the results may not be generalizable to "Third World communities". The authors suggest research to identify subgroups of children who would benefit from antibiotics. Very little discussion of the study's weaknesses by the authors. The authors do not calculate the "file drawer" effect estimate. | ||||
| RD-rate difference | Published criticisms: 1) incorrect use of OR to calculate number needed to treat; using RD, the NNT is 23 (15-56) 2) diagnostic criteria that were not reported varied widely among the studies | ||||
| OR-odds ratio | Possible RCTs Published Since Analysis: 11? |
| Inclusion Criteria | Quality Control |
| RCTs, antimicrobial drugs vs. placebo control | Yes (per Chalmers, Adams, Dickersin, et al., 1990) scores of 11, 10,10, 9, 8, 5, 5, and 2 (0-11 possible) |
| Exclusion Criteria | Articles/Patients |
| none noted | 6/1833 (The number of articles used for each analysis ranged from two to six) |
| Title | Literature Sources | Paper Trail | Questions | Results | Author(s)'s Conclusions/Reviewer(s)'s Comments |
|---|---|---|---|---|---|
| Title | Literature Sources | Paper Trail | Questions | Results | Author(s)'s Conclusions/Reviewer(s)'s Comments |
| Clinical efficacy of antimicrobial drugs for acute otitis media: Meta-analysis of 5400 children from thirty-three randomized trials1 | MEDLINE, 1/66-6/92 inclusive (English and foreign); Current Contents/Life Sciences, 3 months through 6/29/92; bibliographies of textbooks, review articles, source articles, symposium publications; three trials included in the analysis were from non-English language reports | Includes details on numbers of articles at each stage of selection and some descriptive information on included articles | 1) Are antimicrobial drugs more efficacious than placebo or no drug for the clinical resolution of AOM? 2) What is the efficacy of various antimicrobials vs. amoxicillin or ampicillin for the same end point? 3) How does study design affect observed rates of AOM control? 4) How do patient characteristics affect observed rates of AOM control? | 1) Comparisons with placebo/no drug: vs. PCN RD 15.7(4.7-26.7) vs. aminoPCN RD 12.9(6.8-19.0) vs. any ABX RD 13.7(8.2-19.2) 2) a) Comparisons with aminopenicillins: AMP vs. PCN RD −6.8(−15.2-1.5) AMP vs. PCN/SSX RD 0.9(−7.6-9.4) AminoPCN vs. ERY RD 3.1(−3.9-10.2) AminoPCN vs. TMP-SMX 0.2(−8.8-9.2) AMX vs. CFC RD 6.4(−10.2-22.9) AMX vs. CFX RD −3.9 (−10.4-2.6) 2) b) Comparisons with cefaclor: vs. ERY/SSX RD 7.0(−6.5-20.4) vs. AMX/CLV RD 2.8(−1.3-6.8) vs. CFX RD 1.2(−2.4-4.7) 3) RD was unrelated to year, publication year, outcome assessment day, requirement of MEE resolution for primary control, duration of treatment, cointerventions, other antimicrobial drugs, blinding protocol, compliance check, or the quality score. Diagnostic certainty as an independent variable had no significant impact on the regression analysis of RD as the dependent variable. 4) RD was unrelated to bilateral AOM and days since prior antibiotics. | 1) "Should antibiotics be part of the initial empiric therapy for AOM in children? Our meta-analysis suggests that the answer is a qualified yes....Six of every seven children with AOM either do not need antibiotics for primary control or will not respond to antibiotic therapy..." (spontaneous 81% resolution of symptoms without antibiotics) 2) "We did not detect any significant differences in comparative clinical efficacy for standard- vs. extended-spectrum antibiotics..." |
| primary end point: clinical response to antimicrobial therapy defined by absence or presence of presenting signs and symptoms 7-14 days after initiation of therapy including improved TM appearance if reported (somewhat vague description) secondary end point: presence or absence of MEE after resolution of acute infection as close to 30 days after initiation of therapy | (ORs also reported for the primary end point.) (None of the RDs for the secondary end point were significant.) | The authors note that these results apply to children older than 4 weeks of age for initial treatment of uncomplicated AOM and not to other situations. | |||
| Good discussion of study weaknesses by the authors. The authors do not calculate the "file drawer" effect estimate. | |||||
| Possible RCTs Published Since Analysis: 25? |
| Inclusion Criteria | Quality Control |
| RCT; assessment of antimicrobial drugs; initial treatment; simple AOM | Yes (per Marchant and Shurin, 1982) score of 0.62+/-0.20 (0-1 possible) |
| Exclusion Criteria | Articles/Patients |
| studies of specific pathogens; myringotomy; OM not described; unable to extract data for ages 4 weeks to 18 years; most patients had treatment failure; most patients otitis prone | 33/5400 (each meta-analysis utilized at most 5 studies) (47% did not describe randomization procedure; control group could be another antibiotic; only 4 study arms out of 69 were placebo/no drug; double-blind not required; primarily industry funded (61%); included studies with length of treatment 2 days.) |
RD=rate difference, OR=odds ratio,ABX=antimicrobial, AMP=ampicillin, AMX= amoxicillin, CFC=cefaclor, CFX=cefixime,CLV=clavulanate,ERY=erythromycin, PCN=penicillin,TM=tympanic membrance, MEE=middle ear effusion,TMP=trimethoprim,SMX=sulfamethoxazole, SSX=sulfisoxazole
| Title | Literature Sources | Paper Trail | Questions | Results | Author Conclusions/Reviewer Comments |
|---|---|---|---|---|---|
| Title | Literature Sources | Paper Trail | Questions | Results | Author Conclusions/Reviewer Comments |
| What to expect from medical therapy. (Only the acute otitis media meta-analyses will be summarized here.) | MEDLINE, 1996 through July 1998; manual search of symposium proceedings, published otitis media meta-analyses, book chapters, bibliographies of retrieved articles | Does not describe the number of articles initially retrieved from the literature search and the reasons for article rejection. | 1) Are antimicrobials efficacious in the symptomatic relief of AOM pain and fever at 24 hours? 2) Are antimicrobials efficacious in the symptomatic relief of AOM pain and fever at 2-3 days? 3) Are antimicrobials efficacious in the symptomatic relief of AOM pain and fever at 4-7 days? 4) Are antimicrobials efficacious in the complete clinical resolution of AOM within 7-14 days? 5) Are antimicrobials efficacious in the resolution of OME 4-6 weeks after AOM treatment? 6) Are antimicrobials efficacious in the resolution of OME 3 months after AOM treatment? | Antibiotics vs. placebo/no antibiotic RD 0 (−7-8) (three studies; 633 subjects) 2) Antibiotics vs. placebo/no antibiotic RD 4 (2-7) (five studies; 1,241 subjects) 3) Antibiotics vs. placebo/no antibiotic RD 5 (−3-14) (four studies; 785 subjects) 4) Antibiotics vs. placebo/no antibiotic RD 13 (8- 19) (four studies; 612 subjects) 5) Antibiotics vs placebo/no antibiotic RD 3(−2-8) (5 studies, 1,447 subjects) 6) Antibiotics vs placebo/no antibiotic RD 5(−6-16) (2 studies, 371 subjects) | The author mentions that the results might not be generalizable to children with immune deficiencies, cleft palate, craniofacial anomalies, preexisting OME, complicated AOM, and concurrent bacterial infections, and that the 24 hour findings may not be generalizable to very young children. The author also mentions that the subjects in these studies may have less severe disease. |
| Because the results are presented in a textbook, details of the methodology are not presented (e.g., as the number of articles retrieved from the initial literature search and actual quality scores). Also, no measure of heterogeneity is presented; the author assumes that the random effects model will adjust for any heterogeneity. The chapter does have a good discussion on the importance, validity, and generalizability of each result. |
| Inclusion Criteria | Quality Control |
| Randomized controlled trial | Quality scores are not reported. A statement is made that all of the studies in these meta-analyses were randomized and all but one were blinded. |
| Exclusion Criteria | Articles/Patients |
| Not mentioned | See "ANSWER(S)" |
RD=rate difference
OME=otitis media effusion
Individual antibiotics have unique characteristics whose marginal effects on treatment of AOM may be lost by grouping. These marginal effects may be due to antibacterial spectrum, pharmacokinetics, bioavailability, and minimum inhibitory concentrations to specific organisms. In addition, previous meta-analyses (described above) grouped all antibiotics together without regard to antibacterial spectrum or pharmacokinetic properties (Del Mar, Glasziou, and Hayem, 1997; Rosenfeld, 1999b; Rosenfeld, Vertrees, Carr, et al., 1994). The project staff decided that specific comparisons would not need to be repeated unless new studies had been subsequently published that may have had significant effect on the estimate.
The randomized controlled trials comparing ampicillin or amoxicillin with placebo or observational treatment include Halsted, Lepow, Balassanian, et al. (1967); Laxdal, Merida, and Jones (1970); Howie and Ploussard (1972); van Buchem, Dunk, and van't Hof (1981); Burke, Bain, Robinson, et al. (1991); and Kaleida, Casselbrant, Rockette, et al. (1991). The age and otitis-prone status of the study populations in these investigations are described in the Natural History section of this chapter.
The outcomes assessed in these studies are as described in the Natural History section. Rosenfeld (1999b) examined the issue of pain and fever resolution, middle ear effusion, and clinical resolution of symptoms at 7-14 days. An outcome common to three or more of the studies that has not been evaluated is clinical success or failure at 2-7 days. The difficulties with using success or failure as an outcome are detailed in the Natural History section. In particular, Howie and Ploussard (1972) defined failure as the presence of exudate at 2-7 days -- a definition which was unlike those of the other studies -- that included some measure of sign or symptom resolution. van Buchem, Dunk, and van't Hof (1981) did not measure clinical success or failure at 2-7 days, and it was not included in this meta-analysis. Another difficulty was that the data in Kaleida, Casselbrant, Rockette, et al., (1991) used the number of episodes as a denominator rather than the number of unique patients. Episodes are not independent of each other because a patient could have more than one episode of AOM within the study period. The failure of a patient to respond during one episode of AOM is not independent from that patient's response during a subsequent episode of AOM.
| Study (First Author) | Year | Risk Factor 1 Age <2 yr | Risk Factor 2 Otitis Prone (Prior episodes) | Amoxicillin/Ampicillin Sample Size | Placebo Sample Size | Amoxicillin Failure Rate (%) | Placebo Failure Rate (%) | Rate Difference (%) | 95% CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| Halsted | 1967 | 75% <2 yr | Not addressed | 30 | 27 | 33.3 | 25.9 | 7.4 | (−16.2, 31.0) |
| Laxdal | 1970 | 49% <3 yr | Not addressed | 49 | 48 | 10.2 | 37.5 | −27.3 | (−43.4, −11.2) |
| Howie | 1972 | 100% <2.5 yr | Not addressed | 36 | 116 | 52.8 | 79.3 | −26.5 | (−44.4, −8.6) |
| Burke | 1991 | 0% <2 yr | 47%>2 episodes | 114 | 118 | 1.8 | 14.4 | −12.7 | (−19.4, −5.9) |
| Kaleida | 1991 | 50% <2 yr | Not addressed | 488 | 492 | 3.9 | 7.7 | −3.8 | (−6.7, −0.9) |
| Random effects estimates | 717 | 801 | 13.6 | 32.9 | −12.3 | (−21.8, −2.8) | |||
| Test of heterogeneity Chi-square test value | 51.37 | 341.00 | 18.83 | ||||||
| Test of heterogeneity Chi-square test p value | <0.001 | <0.001 | 0.002 | ||||||
| NNT=−8 (−36, −5) | |||||||||
CI=confidence interval
NNT=number needed to treat
| Study (First Author) | Year | Risk Factor 1 Age <2yr | Risk Factor 2 Otitis Prone (Prior episodes) | Amoxicillin/Ampicillin Sample Size | Placebo Sample Size | Amoxicillin Failure Rate (%) | Placebo Failure Rate (%) | Rate Difference (%) | 95%CI of Rate Difference (%) | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Halsted | 1967 | 75% <2yr | Not addressed | 30 | 27 | 33.3 | 25.9 | 7.4 | (−16.2, 31.0) | |||||||||
| Laxdal | 1970 | 49% <3yr | Not addressed | 49 | 48 | 10.2 | 37.5 | −27.3 | (−43.4, −11.2) | |||||||||
| Burke | 1991 | 0% <2yr | 47%>2 epi | 114 | 118 | 1.8 | 14.4 | −12.7 | (−19.4, −5.9) | |||||||||
| Kaleida | 1991 | 50% <2yr | Not addressed | 488 | 492 | 3.9 | 7.7 | −3.8 | (−6.7, −0.9) | |||||||||
| Random effects estimates | 681 | 685 | 6.1 | 19.3 | −9.7 | (−19.2, −0.2) | ||||||||||||
| Test of heterogeneity Chi-square test value | 16.63 | 24.33 | 13.71 | |||||||||||||||
| Test of heterogeneity Chi-square test p value | 0.001 | <0.001 | 0.003 | NNT=−10 (−437, −5) | ||||||||||||||
CI=confidence interval
NNT=number needed to treat
| Study (First Author) | Year | Risk Factor 1 Age <2yr | Risk Factor 2 Otitis Prone (Prior episodes) | Amoxicillin/Ampicillin Sample Size | Placebo Sample Size | Amoxicillin Failure Rate (%) | Placebo Failure Rate (%) | Rate Difference (%) | 95%CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| Halsted | 1967 | 75%<2yr | Not addressed | 30 | 27 | 33.3 | 25.9 | 7.4 | (−16.2, 31.0) |
| Laxdal | 1970 | 49%<3yr | Not addressed | 49 | 48 | 10.2 | 37.5 | −27.3 | (−43.4, −11.2) |
| Burke | 1991 | 0%<2yr | 47%>2 epi | 114 | 118 | 1.8 | 14.4 | −12.7 | (−19.4, −5.9) |
| Random effects estimates | 193 | 193 | 12.5 | 25.0 | −12.9 | (−27.5, 1.7) | |||
| Test of heterogeneity Chi-square test value | 16.22 | 9.69 | 5.89 | ||||||
| Test of heterogeneity Chi-square test p value | <0.001 | 0.008 | 0.053 | ||||||
CI=confidence interval
Other treatment regimens that were compared were the following: amoxicillin-clavulanate, penicillin G plus sulfisoxazole, penicillin V, erythromycin estolate, triple-sulfonamide, and erythromycin estolate-triple sulfonamide vs. placebo or observation.
Appelman, Claessen, Touw-Otten, et al. (1991) compared amoxicillin-clavulanate with placebo or observational treatment; Halsted, Lepow, Balassanian, et al. (1967) compared penicillin G plus sulfisoxazole; Laxdal, Merida, and Jones (1970) and Mygind Meistrup-Larsen, Thomsen, et al. (1981), penicillin V; Howie and Ploussard (1972) compared erythromycin-estolate, triple sulfonamide, and erythromycin-estolate-triple-sulfonamide. The issues regarding the age of these populations and their otitis-prone state are discussed in the Natural History section of this chapter.
The issues regarding these outcomes are the same as those described in the Natural History section.
Having established that antibiotics have some marginal effect on treatment of AOM, it is valid to ask if certain antibiotic regimens have greater marginal effect than others. We asked: Does the specific antibiotic regimen make a difference in outcome? The possibilities for antibiotic comparisons are limitless. These possibilities depend, in part, on differences of antibiotic, dosage, schedule, duration, and other factors. The Technical Expert Panel chose five antibiotic treatments to evaluate.
Traditionally, the first-line antibiotics for treatment of AOM have been amoxicillin and trimethoprim-sulfamethoxazole (Rosenfeld, 1996). A question arose as to whether antibiotics other than these added any marginal benefit to the treatment of AOM. Many of the other antibiotics in question had theoretical benefits in terms of bacterial spectrum, pharmacokinetics, bioavailability, and minimum inhibitory concentrations to specific organisms; however, they also had greater costs and more possible side effects.
Three randomized controlled trials were evaluated that compared penicillin with ampicillin or amoxicillin (Bass, Cashman, Frostad, et al. 1973; Laxdal, Merida, and Jones, 1970; and Nilson, Poland, Thompson, et al. 1969). In one study (Milson, Poland, Thompson, et al., 1969), 79 percent of children were younger than 2 years of age; 49 percent of those children in the second study (Laxdal, Merida, and Jones, 1970) were younger than 3 years of age; and subjects in the third study (Bass, Cashman, Frostad, et al., 1973) ranged in age from 2 months to 12 years, but numbers for specific age strata were not reported. The otitis-prone status of the study patients was not addressed in any of these studies.
| Author/Year | Term(s) | Definition(s) | Time Measured |
|---|---|---|---|
| Penicillin vs. Ampicillin or Amoxicillin | |||
| SUCCESS | |||
| Laxdal/1970 | excellent | no evidence of middle ear inflammation | 7 days |
| good | signs of otitis media resolved | 14 days | |
| fair | signs of otitis media resolved | 21 days | |
| Bass/1973 | therapeutic effectiveness | no therapeutic failure, untoward reaction, or relapse | 4 weeks |
| FAILURE | |||
| Nilson/1969 | unsatisfactory | (1) marked injection >1/3 of TM or (2) marked decrease TM mobility on pneumatic otoscopy or (3) fluid level or bubbles or (4) otorrhea or (5) perforation or (6) marked distortion or obliteration of bony landmarks or (7) any degree of TM distension | 10-12 days |
| Laxdal/1970 | poor | persistent signs of minimal infection | 21 days |
| failure | no improvement or deterioration | 7 days | |
| Bass/1973 | therapeutic failure | no improvement after 48 hours or exacerbation after initial improvement during 14 days of observation with repeat of therapy | <14 days |
| Cefaclor vs. Ampicillin or Amoxicillin | |||
| SUCCESS | |||
| Berman/1983 | satisfactory | total resolution of effusion with normal mobility or residual serous effusion | >5 days |
| Jacobson/1979 | cured | no fever, TM near normal appearance, no ear pain on exam | 1 week |
| McLinn/1980 | cure | disappearance or improvement of signs and symptoms during therapy and elimination or reduction to insignificant numbers of pathogen | 10-21 days |
| Giebink/1984 | satisfactory | absence of fever, irritability, otalgia, and TM erythema | 3 days after ending antibiotic |
| Ploussard/1984 | satisfactory | signs and symptoms had improved or disappeared | at end of therapy |
| FAILURE | |||
| Jacobson/1979 | improvement without cure | no fever, TM slowly resolving but some inflammation remaining | 1 week |
| no improvement | fever, pain, TM unaltered or worse | 1 week | |
| McLinn/1980 | failure | no improvement of signs and symptoms of infection and persistence of pathogen on culture | 10-21 days |
| Berman/1983 | failure | otoscopic findings of persistent bacterial infections (e.g. yellow or red immobile, bulging TM) with symptoms such as irritability and fever | >5 days |
| Ploussard/1984 | unsatisfactory | no improvement of signs and symptoms at end of therapy | >3 days to end of therapy |
| Cefixime vs. Ampicillin or Amoxicillin | |||
| SUCCESS | |||
| McLinn/1987 | favorable=cure or improvement | absence of fever, irritability, otalgia, and TM erythema | 10 days |
| Leigh/1989 | cure | all symptoms resolved | 10-14 days |
| improvement | significant improvement in symptomatology but without complete resolution | 10-14 days | |
| Johnson/1991 | success | absence of fever, otorrhea, earache, and irritability | 3-5 days |
| Principi/1991 | cure, early outcome | normalization of clinical, otoscopic, and tympanometric findings | midtreatment and 15 days |
| improvement, early outcome | relief of acute signs and symptoms with ear effusion by otoscopy and tympanometry | midtreatment and 15 days | |
| cure, late outcome | not failure at early outcome and resolution of otitis media with effusion per otoscopic tympanometric findings | 30, 60, and 90 days | |
| Owen/1993 | improved | TM with dull appearance and decreased mobility or a dry perforation | 4-6 days, 10-13 days, 31-38 days |
| FAILURE | |||
| McLinn/1987 | failure | bacteriologic failure in those with repeat tympanocentesis or clinical failure including recurrence or inability to resolve fever and/or significant otalgia during therapy | 10 days |
| Leigh/1989 | failure | no response to therapy | 10-14 days |
| Johnson/1991 | failure | persistent fever, pain, irritability, or otorrhea | 3-5 days |
| bacteriologic failure | pathogen not eradicated | 3-5 days | |
| Principi/1991 | failure | persistence of signs and symptoms of AOM and/or need to discontinue treatment due to adverse effects | midtreatment and 15 days |
| Owen/1993 | bacterial failure | presence of bacterial pathogen in culture obtained while on or <24 hours after discontinuation of study medication | 4-6 days if without dry perforation, 10 days at discretion of investigator |
| clinical failure | continued or recurrent symptoms with red or yellow, bulging TM or purulent drainage with persistent perforation | 4-6 days, 10-13 days, 31-38 days | |
| Cefaclor vs. Trimethoprim-sulfamethoxazole | |||
| SUCCESS | |||
| Blumer/1984 | satisfactory | absence of fever and otalgia and improved otologic exam | 9-10 days |
| Marchant/1984 | bacterial eradication | eradication of pathogens from the middle ear | 3-6 days |
| symptomatic improvement | decreased irritability per parent or guardian or absence of fever | 3-6 days | |
| FAILURE | |||
| Howie/1985 | unsatisfactory | bulging eardrum or middle-ear drainage | 14 days |
| Study (First Author) | Year | Risk Factor 1 Age <2yr | Risk Factor 2 Otitis Prone (Prior episodes) | Penicillin Sample Size | Amoxicillin or Ampicillin Sample Size | Penicillin Failure Rate (%) | Amoxicillin Failure Rate (%) | Rate Difference (%) | 95% CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| Nilson | 1969 | 79%<2yr | Not addressed | 96 | 101 | 28 | 25 | 3 | (−9, 16) |
| Laxdal | 1970 | 49%<3yr | Not addressed | 45 | 49 | 24 | 10 | 14 | (−1, 29) |
| Bass | 1973 | 2mo-12yr | Not addressed | 100 | 100 | 11 | 9 | 2 | (−6, 10) |
| Random effects estimates | 241 | 250 | 20.6 | 14.4 | 4.5 | (−1.8, 10.7) | |||
| Test of heterogeneity Chi-square test value | 10.85 | 9.86 | 1.97 | ||||||
| Test of heterogeneity Chi-square test p value | 0.004 | 0.007 | 0.374 | ||||||
CI=confidence interval
Five randomized controlled trials compared ampicillin or amoxicillin with cefaclor (Berman and Lauer, 1983; Giebink, Batalden, Russ, et al., 1984; Jacobson, Metcalf, Parkin, et al., 1979; McLinn, 1980; and Ploussard, 1984). The study by Berman and Lauer (1983) focused exclusively on infants age 1-3 months and in the study by Ploussard (1984), 84 percent of the subjects were younger than 2 years of age. McLinn (1980) reported that 45 percent of the subjects were younger than 2 years of age, and Giebink, Batalden, Russ, et al. (1984) reported 44 percent. Jacobson, Metcalf, Parkin, et al. (1979) listed an age range of 1-12 years and a mean age of 3.9 years. Giebink, Batalden, Russ, et al. (1984) reported that 41 percent of their study subjects had more than five previous episodes of AOM. The other studies did not address the otitis-prone state of their subjects.
| Study (First Author) | Year | Risk Factor 1 Age <2 yr | Risk Factor 2 Otitis Prone (Prior episodes) | Cefaclor Sample Size | Amoxicillin or Ampicillin Sample Size | Cefaclor Failure Rate (%) | Amoxicillin Failure Rate (%) | Rate Difference (%) | 95%CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| Jacobson | 1979 | 1-12 yr | Not addressed | 13 | 15 | 15 | 13 | 2 | (−24, 28) |
| Berman | 1983 | 1-3 mo | Not addressed | 19 | 21 | 26 | 29 | −2 | (−30, 25) |
| Giebink | 1984 | 44% <2 yr | 41%>5 episodes | 31 | 30 | 23 | 17 | 6 | (−14, 26) |
| Ploussard | 1984 | 84% <2 yr | Not addressed | 27 | 29 | 0 | 14 | −14 | (−26, −1) |
| Random effects estimates | 90 | 95 | 14.6 | 16.8 | −5.4 | (−15.2, 4.4) | |||
| Test of heterogeneity Chi-square test value | 14.85 | 1.79 | 3.05 | ||||||
| Test of heterogeneity Chi-square test p value | 0.002 | 0.616 | 0.383 | ||||||
CI=confidence intervals
| Study (First Author) | Year | Risk Factor 1 Age <2yr | Risk Factor 2 Otitis Prone (Prior episodes) | Cefaclor Sample Size | Amoxicillin or Ampicillin Sample Size | Cefaclor Failure Rate (%) | Amoxicillin Failure Rate (%) | Rate Difference (%) | 95% CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| Jacobson | 1969 | 1-12yr | Not addressed | 13 | 15 | 15 | 13 | 2 | (−24, 28) |
| McLinn | 1980 | 45% <2yr | Not addressed | 64 | 66 | 5 | 9 | 4 | (−13, 4) |
| Berman | 1983 | 1-3mo | Not addressed | 19 | 21 | 26 | 29 | −2 | (−30, 25) |
| Giebink | 1984 | 44% <2yr | 41%>5 episodes | 31 | 30 | 23 | 17 | 6 | (−14, 26) |
| Ploussard | 1984 | 84% <2yr | Not addressed | 27 | 29 | 0 | 14 | −14 | (−26, −1) |
| Random effects estimates | 154 | 161 | 15.8 | 13.0 | 0.5 | (−5.7, 6.8) | |||
| Test of heterogeneity Chi-square test value | 15.56 | 19.70 | 3.16 | ||||||
| Test of heterogeneity Chi-square test p value | 0.004 | 0.001 | 0.531 | ||||||
CI=confidence intervals
Five randomized controlled trials were evaluated for the comparison of cefixime with ampicillin or amoxicillin (Johnson, Carlin, Super, et al., 1991; Leigh, Robinson, and Millar, 1989; McLinn, 1987; Owen, Anwar, Nguyen, et al., 1993; and Principi and Marchisio, 1991). The study by McLinn (1987) included 61 percent of subjects younger than 2 years of age, and the Principi and Marchisio (1991) study included 40 percent in that age group. The subjects in the Johnson, Carlin, Super, et al. (1991) study had a mean age of 1.5 years and in the Owen, Anwar, Nguyen, et al. (1993) study, a mean age of 1.8 years. The mean age of subjects in the Leigh, Robinson, and Millar (1989) study was 4.9 years. Twenty-seven percent of children in the Johnson, Carlin, Super, et al. (1991) study had more than three prior episodes of AOM, and 26 percent in the Owen, Anwar, Nguyen, et al. (1993) study had more than two episodes. In the Principi and Marchisio (1991) study, 38 percent had one or more episodes of AOM; in the McLinn (1987) study, that number was 62.5 percent. Leigh, Robinson, and Millar (1989) did not address the otitis-prone status of their patients.
| Study (First Author) | Year | Risk Factor 1 Age <2yr | Risk Factor 2 Otitis Prone (Prior episodes) | Cefixime Sample Size | Amoxicillin or Ampicillin Sample Size | Cefixime Failure Rate (%) | Amoxicillin Failure Rate (%) | Rate Difference (%) | 95% CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| McLinn | 1987 | 61%<2yr | 62.5%>1 episodes | 30 | 34 | 3 | 3 | 0 | (−8, 9) |
| Leigh | 1989 | 6m-16yr | Not addressed | 150 | 150 | 5 | 5 | −1 | (−6, 4) |
| Principi | 1991 | 40%<2yr | 38%>1 episodes | 20 | 20 | 10 | 10 | 0 | (−19, 19) |
| Owen | 1993 | 2m-6yr | 26%>3 episodes | 74 | 61 | 26 | 23 | 3 | (−12, 17) |
| Random effects estimates | 274 | 265 | 10.0 | 8.9 | −0.1 | (−4.2, 3.9) | |||
| Test of heterogeneity Chi-square test value | 16.58 | 11.49 | 0.21 | ||||||
| Test of heterogeneity Chi-square test p-value | 0.001 | 0.009 | 0.976 | ||||||
CI=confidence interval
| Study (First Author) | Year | Risk Factor 1 Age <2 yr | Risk Factor 2 Otitis Prone (Prior episodes) | Cefixime Sample Size | Amoxicillin or Ampicillin Sample Size | Cefixime Failure Rate (%) | Amoxicillin Failure Rate (%) | Rate Difference (%) | 95% CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| McLinn | 1987 | 61% <2 yr | 62.5% >1 episodes | 30 | 34 | 3 | 3 | 0 | (−8, 9) |
| Johnson | 1991 | 2m-13 yr | 27% >3 episodes | 20 | 20 | 15 | 15 | 0 | (−22, 22) |
| Principi | 1991 | 40% <2 yr | 38% >1 episodes | 20 | 20 | 5 | 0 | 5 | (−5, 15) |
| Random effects estimates | 70 | 74 | 5.0 | 3.1 | 1.6 | (−5.1, 8.4) | |||
| Test of heterogeneity Chi-square test value | 1.83 | 3.04 | 0.37 | ||||||
| Test of heterogeneity Chi-square test p-value | 0.401 | 0.291 | 0.832 | ||||||
CI=confidence intervals
| Study (First Author) | Year | Risk Factor 1 Age <2yr | Risk Factor 2 Otitis Prone (Prior episodes) | Cefixime Sample Size | Amoxicillin or Ampicillin Sample Size | Cefixime Failure Rate (%) | Amoxicillin Failure Rate (%) | Rate Difference (%) | 95% CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| McLinn | 1987 | 61% <2yr | 62.5% >1 episodes | 60 | 60 | 17 | 15 | 2 | (−11,15) |
| Leigh | 1989 | 6m-16yr | Not addressed | 150 | 150 | 13 | 3 | 9 | (3, 15) |
| Johnson | 1991 | 2m-13yr | 27% >3 episodes | 59 | 51 | 34 | 29 | 4 | (−13, 22) |
| Principi | 1991 | 40% <2yr | 38% >1 episodes | 20 | 20 | 15 | 15 | 0 | (−22, 22) |
| Owen | 1993 | 2m-6yr | 26% >3 episodes | 91 | 93 | 29 | 14 | 15 | (3, 26) |
| Random effects estimates | 380 | 374 | 21.0 | 14.3 | 8.4 | (3.8, 13.1) | |||
| Test of heterogeneity Chi-square test value | 15.70 | 26.36 | 2.95 | ||||||
| Test of heterogeneity Chi-square test p value | 0.003 | <0.001 | 0.567 | ||||||
| NNT=12 (8, 27) | |||||||||
CI=confidence intervals
NNT=number needed to treat
| Study (First Author) | Year | Risk Factor 1 Age <2yr | Risk Factor 2 Otitis Prone (Prior episodes) | Cefixime Sample Size | Amoxicillin or Ampicillin Sample Size | Cefixime Failure Rate (%) | Amoxicillin Failure Rate (%) | Rate Difference (%) | 95% CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| McLinn | 1987 | 61% <2yr | 62.5% >1 episodes | 60 | 60 | 12 | 2 | 10 | (1, 19) |
| Leigh | 1989 | 6m-16yr | Not addressed | 150 | 150 | 1 | 0 | 1 | (−1, 3) |
| Johnson | 1991 | 2m-13yr | 27% >3 episodes | 59 | 51 | 8 | 6 | 3 | (−7, 12) |
| Principi | 1991 | 40% <2yr | 38% >1 episodes | 20 | 20 | 5 | 0 | 5 | (−5, 15) |
| Owen | 1993 | 2m-6yr | 26% >3 episodes | 91 | 93 | 7 | 4 | 2 | (−4, 9) |
| Random effects estimates | 380 | 374 | 5.8 | 1.6 | 2 | (0, 4) | |||
| Test of heterogeneity Chi-square test value | 11.26 | 7.54 | 3.79 | ||||||
| Test of heterogeneity Chi-square test p value | 0.024 | 0.110 | 0.435 | ||||||
CI=confidence interval
| Study (First Author) | Year | Risk Factor 1 Age <2yr | Risk Factor 2 Otitis Prone (Prior episodes) | Cefixime Sample Size | Amoxicillin or Ampicillin Sample Size | Cefixime Failure Rate (%) | Amoxicillin Failure Rate (%) | Rate Difference (%) | 95% CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| McLinn | 1987 | 61% <2 yr | 62.5% >1 episodes | 60 | 60 | 15 | 2 | 13 | (4, 23) |
| Leigh | 1989 | 6m-16 yr | Not addressed | 150 | 150 | 1 | 2 | −1 | (−4, 1) |
| Johnson | 1991 | 2m-13 yr | 27% >3 episodes | 59 | 51 | 22 | 10 | 12 | (−1, 26) |
| Owen | 1993 | 2m-6 yr | 26% >3 episodes | 91 | 93 | 14 | 10 | 4 | (−6, 13) |
| Random effects estimates | 360 | 354 | 12.4 | 4.7 | 5.8 | (−2.4, 13.9) | |||
| Test of heterogeneity Chi-square test value | 36.71 | 9.90 | 12.11 | ||||||
| Test of heterogeneity Chi-square test p value | <0.001 | 0.019 | 0.007 | ||||||
CI=confidence limits
The persistence of Haemophilus influenzae was reported as 0 of 10 in the cefixime group and 5 of 13 in the amoxicillin group in the Johnson, Carlin, Super, et al. (1991) study and 3 of 34 and 9 of 35, respectively, in the Owen, Anwar, Nguyen, et al. (1993) study. Subgroup analysis based on age or otitis-prone status was not reported in any of the studies and was not performed.
Other treatment regimens we compared with ampicillin or amoxicillin included: cephalexin, cephradine, cefuroxime-axetil, ceftriaxone, loracarbef, erythromycin-estolate, erythromycin-ethylsuccinate, clarithromycin, clindamycin, triple sulfonamide, penicillin G plus sulfisoxazole, penicillin V plus sulfisoxazole, penicillin V plus triple sulfonamide, procaine-penicillin-benthazine-penicillin-G plus sulfisoxazole, erythromycin-ethylsuccinate-sulfisoxazole, erythromycin-ethylsuccinate-acetyl-sulfafurazole, and erythromycin-sulfisoxazole.
The studies varied in age of subjects. Four studies were very clear in what proportion of subjects were younger than 2 years of age (Brodie, Griggs, and Cunningham, 1990; Halsted, Lepow, Balassanian, et al., 1967; Nilson, Poland, Thompson, et al., 1969; and Scholz and Noack, 1998). The majority of the remaining studies reported the mean age or age range.
| Author/Year | Comparator Antibiotic | Age | Otitis Prone | Result |
|---|---|---|---|---|
| Ampicillin or Amoxicillin vs.: | ||||
| Bass/1967 | Procaine PCN+Bicillin+sulfisoxazole PCN V+sulfisoxazole Oxytetracycline | <5 years (70%); mean 3.6 years | Not addressed | No difference for failure <14 days for any comparator antibiotic |
| Halsted/1967, 1968 | PCN G+sulfisoxazole | <2 years (75%) | Not addressed | No difference for failure at 24-72 hours |
| Nilson/1969 | PCN V+sulfonamide (also PCN V) | <6 months (15%); 6-12 months (27%); 1-<2 years (36%); 2-3 years (21%) | Not addressed | No difference in unsatisfactory outcome at 10-12 days |
| Bass/1973 | PCN V+sulfisoxazole Erythromycin estolate (also PCN V) | <3 years ("half") | Not addressed | No difference in failure at <14 days or relapses |
| Feigin/1973 | Clindamycin | Mean 1.6 years | Not addressed | No difference in response at 3-4 days |
| Nassar/1974 | Cephalexin | Mean 4.9 years | Otitis prone (52%) | No difference in failure at 14 days |
| Stechenberg/1976 | Cephalexin | Mean 1.5 years | Not addressed | No difference in clinical response by 10 days |
| McLinn/1979 | Cephradine | Mean cephradine 1.9 years and amoxicillin 2.4 years | Not addressed | No difference in initial improvement or in overall outcome at 10 days or recurrence through 12 months |
| Rodriguez/1985 | Erythromycin sulfisoxazole | Mean 3.2 years | Not addresssed | No difference in failure at 10-14 days, recurrence at 30 days, or persistent middle ear effusion at 10-14 or 28 days |
| Brodie/1990 | Cefuroxime axetil | <2 years (36%) | Not addressed | No difference for failure 1-4 days; no difference stratified by age |
| Foshee/1992 | Loracarbef | Mean loracarbef 3.36 years and amoxicillin 3.59 years | Not addressed | No difference in failure at 7-10 days |
| Coles/1993 | Clarithromycin | Mean clarithromycin 5.8 years and amoxicillin 5.3 years | Not reported | No difference in failure at 6-9 days |
| Pukander/1993 | Clarithromycin | Range 1-12 years | Not addressed | No difference in failure at 48 hours |
| Kara/1998 | Cefuroxime-axetil (also ceftriaxone) | Range 6 months-6 years | Not addressed | No difference in failure at 5 days |
| Lenoski/1968 | EES; Triple sulfonamide (also EES+triple sulfonamide) | <3 years (58%) | Not addressed | No difference in failure at 14 days but numbers small; no difference stratified by age but numbers small |
| Scholz/1998 | Erythromycin estolate | <2 years (14%) | Not addressed | No difference in failure at 9-11 days nor recurrence up to 41 days |
| Feldman/1990 | Amoxicillin-clavulanate | Mean 60 months | Not addressed | Failure at 12-16 days was 7 of 101 in the TMP-SMX and 18 of 101 for amoxicillin-clavulanate, p=0.03 |
PCN=penicillin
EES=erythromycin ethylsuccinate
TMP-SMX=trimethoprim-sulfamethoxazole
Three studies were eligible for this comparison (Blumer, Bertino, and Husak, 1984; Howie, Dillard, and Lawrence, 1985; and Marchant, Shurin, Turcyzk, et al., 1984). All children in the Marchant, Shurin, Turcyzk, et al. (1984) study were younger than 2 years of age. The subjects in the Blumer, Bertino, and Husak (1984) study ranged from 3 months to 7 years of age. Howie, Dillard, and Lawrence (1985) did not report on the ages of their patients. In the Blumer, Bertino, and Husak (1984) study, 38 percent of the patients were described as having recurrent otitis. In the other two studies, the issue of otitis-prone status was not addressed.
Meta-analysis of the data from the three studies on the failure rate at less than 14 days of treatment comparing cefaclor with trimethoprim-sulfamethoxazole yielded a pooled rate difference of 5.5 percent (95 percent CI, −1.6 percent and 12.6 percent), a rate that was not statistically significant. Although the studies showed significant heterogeneity among failure rates, their rate differences were not significantly heterogeneous.
Two studies compared trimethoprim-sulfamethoxazole with amoxicillin-clavulanate or ceftriaxone (Barnett, Teele, Klein, et al., 1997 and Feldman, Sutcliffe, and Dulberg, 1990). One study (Barnett, Teele, Klein, et al., 1997) accounted for the otitis-prone status of their patients in the analysis.
As with the studies in the meta-analytic comparisons, the outcomes in this group also were diverse and nonuniform in the selection and definition of success and failure.
No trend was observed favoring amoxicillin-clavulanate or ceftriaxone over trimethoprim-sulfamethoxazole or vice versa. In the Barnett, Teele, Klein, et al. (1997) study, those identified as otitis prone had a failure rate of 24 percent in the ceftriaxone group and 23 percent in the trimethoprim-sulfamethoxazole group. The respective numbers for the patients who were not otitis prone were 26 percent and 19 percent. The Barnett, Teele, Klein, et al. (1997) data suggested that the otitis-prone status of the child did not have an effect on the outcome of failure at 14 days.
No studies were found that compared oral fluoroquinolones with another antibiotic in the initial treatment of uncomplicated AOM in childhood.
As the incidence of bacterial resistance to antibiotics increases, modifications in treatment of AOM must be considered. These modifications may include use of different or new antibiotics or the use of familiar antibiotics in new ways. One proposal has been to increase the dosage of amoxicillin or amoxicillin-clavulanate. The question we posed was: What is the value of using > 60 mg/kg/day of amoxicillin or amoxicillin-clavulanate vs. the standard 40 mg/kg/day in the initial treatment of uncomplicated AOM?
One study compared high-dose amoxicillin-clavulanate with standard-dose amoxicillin-clavulanate in the treatment of AOM in children, 43 percent of whom were younger than 2 years of age. The issue of otitis-prone status was not addressed (Bottenfield, Burch, Hedrick, et al., 1998).
The study assessed clinical response at the end of therapy, recurrence at 22-28 days, and adverse effects (Bottenfield, Burch, Hedrick, et al., 1998).
Compliance with antibiotic treatment of AOM has been an issue. One proposal to increase compliance is to decrease the daily dosages of antibiotics from three to two.
One study was identified that addressed the issue of high-dose amoxicillin two times a day vs. three times a day (Principi, Marchisio, Bigalli, et al., 1986). Fourteen percent of the patients were younger than 1 year old, and 67 percent were 1-5 years of age. Six percent had had three or more prior episodes of AOM, and 29 percent had had one or two prior episodes.
Principi, Marchisio, Bigalli, et al. (1986) looked at clinical cure or failure and presence of unilateral or bilateral effusion at 15 days and clinical cure, presence of unilateral or bilateral effusion, and recurrence at 30 days, 60 days, and 90 days.
As already noted, compliance with antibiotic treatment of AOM has been an important issue to the practitioner and patient. Another proposal to increase compliance is to decrease the duration of therapy. The question we posed was: What is the comparative effectiveness of short-term vs. long-term antibiotic therapy in children younger than 2 years of age and those older than 2 years of age in the initial treatment of uncomplicated AOM?
| Title | Literature Sources | Paper Trail | Questions | Results | Author Conclusions/Reviewer Comments | Source | Inclusion Criteria | Quality Control | Authors | Exclusion Criteria | Articles/Patients |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Treatment of Acute Otitis Media With a Shortened Course of Antibiotics: A Meta-analysis. | MEDLINE, 1/66-7/97; EMBASE, 1/74-7/97; Current Contents, 1/97-7/97; Science Citation Index searches; reference lists of relevant publications; no language restrictions and two trials included in the analysis were from non-English language reports | includes details on numbers of articles at each stage of selection and detailed descriptive information on included articles. | 1) Are short-acting antibiotics given for 48 hours or less as effective as antibiotics given for at least 7 days in treatment of AOM? 2) Are short-acting antibiotics given for more than 48 hours but < 5 days as effective as antibiotics given for at least 7 days of treatment of AOM? 3) Is ceftriaxone as effective as antibiotics given for 10 days treatment of AOM? 4) Is 3-5 days of azithromycin as effective as 10 days of another antibiotic in treatment of AOM? stratifications: older and younger than 2 years; perforated and nonperforated tympanic membranes primary outcome: treatment failure noted by lack of clinical resolution or relapse or recurrence of AOM during a 31-day period following therapy initiation as defined by improvement or resolution of presenting signs and symptoms secondary outcome: cumulative number of treatment failures, relapses, and recurrences from diagnosis until final evaluation at 1-3 months (MEE was not counted a treatment failure.) | 1) OR for treatment failure at less than one month 2.99(1.04-8.54) 2) a) OR for treatment failure at 8-10 days 1.38(1.15-1.66) 2) b) OR for treatment failure at 20-30 days 1.22(0.98-1.54) (Results 2) a) did not change with quality of study, adequacy of concealment of treatment allocation, exclusion of children with chronic or recurrent OM. 2) b) results for the most part were also not affected.) 3) OR for treatment failure at one month or less and at 3 months or less 1.25 (0.90-1.72) and 0.91 (0.57-1.47) respectively 4) OR for treatment failure 1.09 (0.86-1.38) OR for gastrointestinal side effects for short course versus long course short-acting antibiotics 0.54 (0.43-0.66) when amoxicillin-clavulanate was included in the analysis. Children on azithromyicin also had less likelihood of gastrointestinal side effects OR 0.26 (0.19-0.37) | 1) Short-acting antibiotics for < 48 hours is not as effective. 2) "Our meta-analysis results indicate that at an early evaluation point (8 to 19 days) a reduction in treatment from 10 to 5 days of short-acting antibiotics may slightly increase the risk of a child experiencing signs and symptoms or relapse or reinfection...However, by 30 days following initiation of therapy, a longer course of short-acting antibiotics was comparable to a 5-day course in terms of these outcomes...13 children would require treatment with a long course of antibiotics to prevent 1 excess failure following treatment with a shorter course....the risk difference at 1 month following treatment dropped to 2.3%...44 children requiring treatment with a longer course of antibiotics to prevent 1 failure following treatment." 3) Ceftriaxone was comparable. 4) Azithromycin was comparable. The authors state that subgroup samples were too small to assess the proposed stratifications. Good discussion of plausibility of results and weaknesses of the study by the authors. Possible RCTs published since analysis: 4? | JAMA | randomized controlled trials; treatment of AOM; comparing different durations of antibiotic treatment, fewer than 7 days vs at least 7 days; patients 4 weeks to 18 years age; no antimicrobial therapy at time of diagnosis; an assessment of clinical resolution of AOM | Yes (per Moher, Jadad, Nichol, et al., 1995) average score 2.66(SD,0.97) (0-5 possible) Also rated for concealment of treatment allocation. 9 trials in 8 articles reported adequate concealment | Kozyrskyj, Hildes-Ripstein, Longstaffe, et al., 1998 | planned surgical cointervention except myringotomy subsequent to treatment failure or tympanocentesis (use of a second antibiotic was deemed a treatment failure and not excluded) | 29 with 32 trials/9073 (each meta-analysis utilized at most 5 studies) (only 31% of studies on short-acting antiiotics excluded children with chronic or recurrent OM) |
AOM=acute otitis media
MEE=middle ear effusion
OM=otitis media
OR=odds ration
RCT=randomized controlled trial
Synthesizing two studies on short-acting antibiotics given for 48 hours or less vs. long-duration therapy, the odds ratio was 2.99 (95 percent CI, 1.04 percent and 8.54 percent), which indicates a significant difference in risk when looking at treatment failure at less than 1 month followup; however, only two studies were quantitatively synthesized in this comparison. Comparing short-acting antibiotics given for more than 48 hours and less than 5 days vs. therapy of at least 7 days with treatment failure at 8-10 days as the outcome, the odds ratio was 1.38 (95 percent CI, 1.15 percent and 1.66 percent), which indicates a significant difference in risk. In the previous comparison, if the outcome was treatment failure at 20-30 days, the odds ratio was reduced to 1.22 (95 percent CI, 0.98 percent and 1.54 percent), indicating no significant difference in risk. These last two results were not affected by study quality, adequacy of treatment allocation concealment, or exclusion of subjects with chronic or recurrent otitis media.
The comparison of ceftriaxone to antibiotic duration of 10 days yielded an odds ratio for treatment failure at less than 1 month followup of 1.25 (95 percent CI, 0.90 percent and 1.72 percent), indicating no significant difference in risk. For treatment failure at less than 3 months followup, the odds ratio was 0.91 (95 percent CI, 0.57 percent and 1.47 percent), indicating no significant difference in risk. The meta-analysis on treatment for 3-5 days with azithromycin vs. 10-day therapy with another antibiotic yielded an odds ratio of 1.09 (95 percent CI, 0.86 percent and 1.38 percent), indicating no significant difference in risk.
It was concluded that treatment with short-acting antibiotics given for less than 48 hours was not as effective as antibiotic therapy given for at least 7 days (Kozyrskyj, Hildes-Ripstein, Longstaffe, et al., 1998), and that decreasing the duration of therapy from 10 days to 5 days might slightly increase the risk of treatment failure at 8-10 days (although by 30 days that difference would no longer exist). The latter conclusion is invalid because the difference in risk between 5-day and 10-day therapies at 20-30 days was not significant. In other terms, for the previous comparison, 13 children would need to be treated with the longer-duration therapy to prevent one excess failure that would occur with the 5-day treatment relative to 8-10 day treatment failure. Ceftriaxone and 3- to 5-day azithromycin seemed comparable to 10-day antibiotic treatment.
| Study (First Author) | Year | Risk Factor 1 Age <2yr | Risk Factor 2 Otitis Prone (Prior episodes) | Ceftriaxone Sample Size | Amoxicillin Sample Size | Ceftriaxone Failure Rate (%) | Amoxicillin Failure Rate (%) | Rate Difference (%) | 95% CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| Varsano | 1988 | 6 mo-8 yr | 58% >2 epidoes | 22 | 22 | 18 | 14 | 5 | (−17, 26) |
| Green | 1993 | 5 mo-5 yr | 18% >2 episodes | 105 | 107 | 6 | 3 | 3 | (−3, 8) |
| Kara | 1998 | 6 mo-6 yr | Not addressed | 25 | 25 | 16 | 8 | 8 | (−10, 26) |
| Random effects estimates | 152 | 154 | 10.5 | 5.1 | 3.4 | (−1.6, 8.5) | |||
| Test of heterogeneity Chi-square test value | 3.65 | 2.79 | 0.30 | ||||||
| Test of heterogeneity Chi-square test p value | 0.161 | 0.248 | 0.862 | ||||||
CI=confidence intervals
| Author/Year | Term(s) | Definition(s) | Time Measured |
|---|---|---|---|
| Ceftriaxone (1 injection) vs. Amoxicillin (7-10 days) | |||
| SUCCESS | |||
| Varsano/1988 | satisfactory | resolution of middle ear fluid and of signs and symptoms of AOM or persistence of some degree of effusion but without erythema or bulging and with no fever or pain | 7 days, 30 days |
| Green/1993 | Successful | resolution of AOM symptoms and no return of symptoms within 10 days of emergency department visit | 10 days, measured at 90 days |
| FAILURE | |||
| Varsano/1988 | failure, early | persistence or recurrence of fever and/or pain with otoscopic signs of acute ear infection or spontaneous otorrhea during the first 10 days | 7 days |
| Green/1993 | unsuccessful | not successful | 10 days, measured at 90 days |
| failure | persistence or recurrence of symptoms within 10 days of initiating treatment | 10 days, measured at 90 days | |
| Kara/1998 | no improvement or treatment failure | based on "resolution of symptoms and clinical and tympanometric appearance of the tympanic membrane" | 5 days |
| Azithromycin (<5 days) ves. Amoxicillin-Clavulanate (7-10 days) | |||
| SUCCESS | |||
| Pestalozza/1992 | cured | normalization of clinical, otoscopic, and tympanometric findings | 3-5 days, 12-14 days, 30 days |
| improved | relief of acute signs and symptoms with persistent middle ear effusion | 3-5 days, 12-14 days, 30 days | |
| Daniel/1993 | cured | resolution of signs and symptoms of primary infection | 3-5 days, 10-12 days |
| improvement | signs and symptoms subsided but with incomplete resolution | 3-5 days, 10-12 days | |
| Schaad/1993 | cure | disappearance of baseline symptoms of infection | 7-20 days |
| Principi/1995 | bacterial eradication | baseline pathogen not isolated upon repeat sampling or no culturable material obtainable because of clinical cure | 10-14 days, aspirate only if no improvement |
| cured | all pretreatment signs and symptoms disappeared | 10-14 days | |
| Improved | Improvement or partial disappearance of pretreatment signs and symptoms | 10-14 days | |
| Arguesdas/1996 | satisfactory | complete resolution of initial symptoms regardless of middle ear fluid | 10-11 days |
| FAILURE | |||
| Pestalozza/1992 | failed | no change or worsening of pretreatment signs | 3-5 days, 12-14 days, 30 days |
| Daniel/1993 | failure | no apparent clinical response | 3-5 days, 10-12 days |
| Schaad/1993 | failure | no change in or worsening of symptoms from baseline | 7-20 days |
| Principi/1995 | bacterial persistence | baseline pathogen present in post therapy sample | 10-14 days, aspirate only if no improvement |
| failed | no change or worsening of pretreatment signs and symptoms | 10-14 days | |
| Arguesdas/1996 | failure | bacteriologic or clinical failure | 10-11 days |
| bacteriologic failure | inability to sterilize the middle ear fluid in patients with persistent ear drainage or who had repeated tympanocentesis | at discretion of investigator | |
| Study (First Author) | Year | Risk Factor 1 Age <2yr | Risk Factor 2 Otitis Prone (Prior episodes) | Ceftriaxone Sample Size | Amoxicillin Sample Size | Ceftriaxone Failure Rate (%) | Amoxicillin Failure Rate (%) | Rate Difference (%) | 95% CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| Varsano | 1988 | 6 mo-8 yr | 58% >2 episodes | 22 | 22 | 18 | 14 | 5 | (−17, 26) |
| Green | 1993 | 5 mo-5 yr | 18% >2 episodes | 105 | 107 | 10 | 9 | 1 | (−7, 9) |
| Kara | 1998 | 6 mo-6 yr | Not addressed | 25 | 25 | 16 | 8 | 8 | (−10, 26) |
| Random effects estimates | 152 | 154 | 12.0 | 9.5 | 2.5 | (−4.4, 9.5) | |||
| Test of heterogeneity Chi-square test value | 1.12 | 0.40 | 0.51 | ||||||
| Test of heterogeneity Chi-square test p value | 0.570 | 0.819 | 0.775 | ||||||
CI=confidence intervals
Five randomized controlled trials were eligible for the comparison of less than 5-day azithromycin therapy vs. 7- to 10-day amoxicillin-clavulanate therapy (Arguedas, Loaiza, Herrera, et al., 1996; Daniel, 1993; Pestalozza, Cioce, and Facchini, 1992; Principi, 1995; and Schaad, 1993). In the Pestalozza, Cioce, and Facchini (1992) study, patients had a mean age of 3 years. The proportion of patients younger than 2 years of age was 1 percent in the Daniel (1993) study, 7.5 percent in the Schaad (1993) study, and 25 percent in the Principi (1995) study. Arguedas, Loaiza, Herrera, et al. (1996) reported an age range of 6 months to 12 years. In the Principi (1995) study, 10 percent of the subjects had recurrent otitis media. The other studies did not report on the otitis-prone status of their subjects.
| Study (First Author) | Year | Risk Factor 1 Age <2yr | Risk Factor 2 Otitis Prone (Prior episodes) | Azithromycin Sample Size | Amox-Clav Sample Size | Azithromycin Failure Rate (%) | Amox-Clav Failure Rate (%) | Rate Difference (%) | 95%CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| Pestalozza | 1992 | 11 mo-9 yr | Not addressed | 15 | 15 | 0 | 0 | 0 | (−, −) |
| Daniel | 1993 | 1% <2 yr | Not addressed | 103 | 54 | 6 | 0 | 6 | (1, 10) |
| Schaad | 1993 | 7.5% <2 yr | Not addressed | 192 | 189 | 3 | 1 | 3 | (−0, 5) |
| Principi | 1995 | 25% <2 yr | 10% recurrent | 203 | 182 | 8 | 6 | 2 | (−3, 7) |
| Arguedas | 1996 | 6 mo-12 yr | Not addressed | 47 | 45 | 0 | 4 | −4 | (−10, 2) |
| Random effects estimates | 560 | 485 | 3.6 | 1.9 | 2.1 | (−0.6, 4.8) | |||
| Test of heterogeneity Chi-square test value | 12.66 | 10.64 | 5.34 | ||||||
| Test of heterogeneity Chi-square test p value | 0.013 | 0.031 | 0.254 | ||||||
Amox-Clav=amoxicillin-clavulanate
Cl=confidence interval
Three randomized controlled trials compared 5-day azithromycin therapy to 7-10 day amoxicillin-clavulanate therapy (Aronovitz, 1996; Khurana, 1996; McLinn, 1996). The Aronovitz (1996) study population was 2 years of age or older. The mean age of the patients in the Khurana (1996) study was 5.6 years and 53 percent were 5 years old or younger. The age range for the McLinn (1996) study population was 1-15 years. Fifteen percent of the Khurana (1996) population had more than two prior episodes of AOM. The other two studies did not address the otitis-prone status.
| Study (First Author) | Year | Risk Factor 1 Age <2yr | Risk Factor 2 Otitis Prone (Prior episodes) | Azithromycin Sample Size | Amox-Clav Sample Size | Azithromycin Failure Rate (%) | Amox-Clav Failure Rate (%) | Rate Difference (%) | 95%CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| Aronovitz | 1996 | 0% <2 yr | Not addressed | 85 | 84 | 4 | 31 | −27 | (−38, −17) |
| Khurana | 1996 | 6 mo-12 yr | 15% >2 episodes | 263 | 260 | 7 | 17 | −10 | (−16, −5) |
| McLinn | 1996 | 1-15 yr | Not addressed | 340 | 334 | 9 | 31 | −22 | (−28, −16) |
| Random effects estimates | 688 | 678 | 6.8 | 26.0 | −19.2 | (−29.2, −9.2) | |||
| Test of heterogeneity Chi-square test value | 4.43 | 17.32 | 12.49 | ||||||
| Test of heterogeneity Chi-square test p-value | 0.109 | <0.001 | 0.002 | ||||||
| NNT=−5 (−11, −3) | |||||||||
NNT=number needed to treat
CI=confidence interval
Amox-Clav=amoxicillin-clavulanate
| Study (First Author) | Year | Risk Factor 1 Age <2yr | Risk Factor 2 Otitis Prone (Prior episodes) | Azithromycin Sample Size | Amox-Clav Sample Size | Azithromycin Failure Rate (%) | Amox-Clav Failure Rate (%) | Rate Difference (%) | 95%CI of Rate Difference (%) |
|---|---|---|---|---|---|---|---|---|---|
| Aronovitz | 1996 | 0% <2 yr | Not addressed | 85 | 84 | 4 | 30 | −26 | (−37, −16) |
| Khurana | 1996 | 6 mo-12 yr | 15% >2 epi | 263 | 260 | 6 | 15 | −9 | (−14, −4) |
| McLinn | 1996 | 1-15 yr | Not addressed | 340 | 334 | 8 | 29 | −21 | (−26, −15) |
| Random effects estimates | 688 | 678 | 6.1 | 18.7 | −18.0 | (−28.0, −8.0) | |||
| Test of heterogeneity Chi-square test value | 3.19 | 19.83 | 13.48 | ||||||
| Test of heterogeneity Chi-square test p-value | 0.203 | <0.001 | 0.001 | ||||||
| NNT=−6 (−13, −4) | |||||||||
NNT=number needed to treat
CI=confidence interval
Amox-Clav=amoxicillin-clavulanate
In addition, individual studies (Aronovitz, 1996; McLinn, 1996) showed no differences in 11-day and 30-day failure rates between azithromycin (5 days) and amoxicillin-clavulanate (10 days).
| Author | Age | Otitis Prone | Result 1 |
|---|---|---|---|
| Amoxicillin (<5 days) vs. Amoxicillin (7-10 days) | |||
| Chaput de Saintonge/1982 | >2 years (100%) | >1 episode in previous excluded from study | No difference in sign and symptom resolution days 3 and 15, failure at 15 days, recurrences, complications |
| Bain/1985 | >2 years (100%) | History of otitis media 75% | No difference in earache at 1 day, of 5 days, or 10 days; resolution of eardrum findings at 7 days or recurrence at 1 year |
| Puczynski/1987 | >2 years (100%) | Not addressed | Significantly greater failure in the single dose group 3 of 7 vs. 0 of 10 |
| Penicillin V (<5 day) vs. Penicillin V (7-10 day) | |||
| Meistrup-Larsen/1983 | Mean 4.5 years | Not addresssed | No difference in unsatisfactory course at 14 days, but small numbers |
| Penicillin V (5 day) vs. Penicillin V (7-10 day) | |||
| Ingvarsson/1982 | <2 years (24%) | Not addressed | No difference in not healed, which includes serous otitis media or relapses or therapeutic failure at 28-30 days nor in the individual components; higher percentage not healed if <2 years |
| Benthazine Penicillin G (1 dose) vs. tetracycline (7-10 day) or Benthazine Penicillin (1 dose) plus Triple-sulfonamide (7 day) | |||
| Rubenstein/1965 | <2 years (48%) | Not addressed | Failure 4 of 79 (5%) vs. 10 of 78 (13%); no difference between bicillin and bicillin+triple-sulfonamide |
| Benthazine Pencillin G (1 dose) vs. Benthazine Pencillin (1 dose) plus Triple-sulfonamide (7 day) | |||
| Stickler/1967 | <2 years (45%) | Not addressed | No difference in 2 week clinical failure |
| Amoxicillin-clavulanate (5 day) vs. Amoxicillin-clavulanate (7-10 day, either twice-a-day or three-times-a-day) | |||
| Hoberman/1997 | <2 years (39%) | Not addressed | No difference in failure at 12-14 days or 32-38 days |
| Cohen/1998 | <2.5 years (100%) mean 1.1 years | >3 episodes (9%), 2 episodes (11%), 1 episode (23%) | Greater failure at 12-14 days in shorter duration group (23% vs. 12 %) |
| Cefaclor (<5 day) vs. cefaclor (7-10 day) | |||
| Jones/1986 | >2 years (100%) mean 5.7 years | History of otitis media (77%) | No difference in earache > 4 days or resolution of ear signs or recurrence within 6 weeks |
| Cefaclor (5 day) vs. Amoxicillin (7-10 day) | |||
| Ploussard/1984 | <2 years (84%) | Not addressed | No difference in unsatisfactory outcome or recurrence but numbers small; all unsatisfactory outcomes and recurrences occurred in <2 year old patients |
| Cefaclor (5 day) vs. Cefaclor (7-10 day) | |||
| Hendrickse/1988 | <2 years (53%) | Otitis prone (20% 2 ) | With intact TM no difference in failure at <5 days or 6-10 days; reinfection at 14-30 days, or 31-60 days, or 61-90 days; persistent middle ear effusion rate at 10-15 days 30 days, 60 days, 90 days; with perforated TM no difference in reinfection or middle ear effusion rate but 46% to 8% difference in 6-10 day failure rate |
| Cefuroxime-axetil (5 day) vs. Cefuroxime-axetil (10 day) vs. Amoxicillin-clavulanate (7-10 day) | |||
| Gooch/1996 | Mean 3.5 years | Prior episode (84%) Prior episode within 1 year (84%) | No difference in clinical failure after 3 days, recurrence 14-18 days after treatment end, or bacteriologic failure |
| Cefpodoxime-proxetil (5 day) vs. Amoxicillin-clavulanate (7-10 day) | |||
| Cohen/1997 (article 426 and 2325) | Mean 1.5 years <2 years (75%) | Not addressed Recurrent acute otitis media (25%) | Difference in nasopharyngeal pneumococcus persistence of (59% vs. 36%, p=0.01); no difference in nasopharyngeal H. influenzae persistence; both 2-6 days after treatment end No difference in failure 4 days after treatment end and at 17 days nor in serous otitis media at 1 month after treatment 24% vs. 18% with new acute otitis media at 1 month after treatment end |
| Cefpodoxime-proxetil (5 day) vs. Cefaclor (7-10 day) | |||
| Adams/1995 | Mean 3.5 years | Not addresed | No difference in failure at 11-13 days or relapse at 3 weeks |
| Cefpodoxime-proxetil (5 day) vs. Cefixime (7-10 day) | |||
| Boulesteix/1995 | Range 6 months-6 years | Otitis prone excluded | No difference in unsatisfactory course at 8-10 days and 30-40 days or relapse at 30-40 days |
| Cefprozil (5 day) vs. Cefprozil (7-10 day) | |||
| Kafetzis/1997 | Mean 4.1 years | >2 episodes (3%) 2 episodes (6%) 1 episode (24%) | No difference in failure at 28-32 days or relapse after end of treatment |
| Ceftibuten (5 day) vs. Ceftibuten (10 day) | |||
| Simon/1997 | Mean 3.7 years | Not addressed | More failure with the short-duration group (22% vs. 2%) and more recurrence at 14 days (14% versus 8%) |
| Ceftriaxone (1 dose) vs. Amoxicillin-clavulanate (7-10 day) | |||
| Bauchner/1996 | <1.5 years (34%) | >2 prior episodes (11%) 1 prior episode (25%) | Unimproved or worse in 50 of 267 (19%) vs. 28 of 271 (10%); parents dissatisfacton with antibiotic significant with 8% vs. 11% |
| Varsano/1997 | Mean 2.7 years | Otitis prone 2 (13%) | No difference failure at 11 days or relapses at 12-30 days; higher recurrence at 31-90 days in amoxicillin-clavulanate group; more diarrhea and vomiting with amoxicillin-clavulanate |
| Ceftriaxone (1 dose) vs. Cefaclor (7-10 day) | |||
| Chamberlain/1994 | >1.5 years (100%) mean 3 years | <4 AOM per year (100% by exclusion of others) mean 1.4 episodes/year | No difference in failure at 14 days, recurrence at <14 days or 90 days, or persistent effusion 90 days |
| Ceftriaxone (1 dose) vs. Cefuroxime-axetil (7-10 day) | |||
| Kara/1988 (also vs. amoxicillin) | Range 6 months-6 years | Not addressed | No difference in failure at day 5 but very small numbers |
| Ceftriaxone (1 dose) vs. Trimethoprim-sulfamethoxazole (7-10 day) | |||
| Barnett/1997 | Mean ceftriaxone 17.3 months and TMP-SMX 18 months | >3 prior episodes (41%) | Equivalent noncured rates at 14 days and 28 days but not at 3 days; otitis-prone status did not have an effect; those who failed appeared to be of younger mean age |
| Azithromycin (<5 day) vs. Cefaclor (7-10 day) | |||
| Rodriguez/1996 | Mean 4 years | Not addressed | No difference in failure at 10-14 days; less failure in azithromycin at 25-30 days |
| Azithromycin (<5 day)
vs. Clarithromycin (7-10 day) | |||
| Arguedas/1997 | Mean 4.2 years | Not addressed | No difference in clinical failure by end of therapy |
| Azithromycin (5 day) vs. Amoxicillin-clavulanate (7-10 day) | |||
| Aronovitz/1996 | <2 years (0%) | Not addressed | No difference in failure rate at 11 days or 30 days. Relapse assessed at 15-35 days was higher in the amoxicillin-clavulanate group, (21 %), compared to the azithromycin group, (5 %). |
| Khurana/1996 | Range 6 months-12 years | >2 episodes (15%) | No difference in failure rate at 3 days or relapse before 14 days, recurrence after 14 days, or total unsatisfactory response. |
| McLinn/1996 | Range 1-15 years | Not addressed | No difference in failure rate at 11 days or 30 days. |
comparative results report short-duration result then long-duration result
meets technical expert panel of otitis prone
Fourteen of these studies reviewed indicated that the proportion of subjects were younger or older 2 years of age. Nine studies reported a mean age alone. Two studies only reported an age range. In nine studies, at least 20 percent of the subjects appeared to have been younger than 2 years of age (Bauchner, Adams, Barnett, et al., 1996; Cohen, de La Rocque, Boucherat, et al., 1997; Cohen, Levy, Boucherat, et al., 1998; Hendrickse, Kusmiesz, Shelton, et al., 1988; Hoberman, Paradise, Burch, et al., 1997; Ingvarsson and Lundgren, 1982; Ploussard, 1984; Rubenstein, McBean, Hedgecock, et al., 1965; Stickler, Rubenstein, McBean, et al., 1967). Thirteen studies indicated the proportion of subjects who had previous episodes of AOM, and three studies excluded patients with varying degrees of previous episodes (Bain, Murphy, and Ross, 1985; Boulesteix, Durbreuil, Moutot, et al., 1995; Chamberlain, Boenning, Waisman, et al., 1994). Twelve studies did not address the issue of otitis-prone status.
Nineteen of these 24 studies did not demonstrate any difference in effectiveness between the short-duration and long-duration therapy in the outcomes measured. Puczynski, Stankiewicz, and O'Keefe (1987) found, however, a significantly greater failure rate in the single-dose amoxicillin group compared with the 10-day amoxicillin group. Rubenstein, McBean, Hedgecock, et al. (1965) found a higher failure rate in those treated with long-duration tetracycline compared with a single dose of benthazine penicillin G. Cohen, Levy, Boucherat, et al. (1998) found a greater failure rate at 12-14 days in the 5-day duration of the amoxicillin-clavulanate group vs. the long-duration group. Henrickse, Kusmiesz, Shelton, et al. (1988) found a higher failure rate among those with a perforated tympanic membrane who were on short-duration cefaclor therapy at 6-10 days. Simon (1997) found a higher failure rate with short-duration ceftibuten therapy compared with long-duration ceftibuten therapy.
Only three studies looked specifically at the effect of age or otitis-prone status on any of the outcomes. Paradise (1997) reports in an editorial on age-stratified results from the Hoberman, Paradise, Burch, et al. (1997) study that, compared with 5-day treatment, 10-day treatment had significantly improved outcomes at days 12-14 and 32-38 for children younger than 2 years and at days 12-14 for children 2-5 years old. Paradise (1997) only reports on the twice-a-day amoxicillin-clavulanate regimen for 10 days and not the three-times-a-day amoxicillin-clavulanate regimen for 10 days. Ingvarsson and Lundgren (1982) stratified the "not healed" results by age. For treatment with the 5-day penicillin V, 25 percent of the children younger than 2 years were not healed and 20 percent of those 2 years and older were not healed. For treatment with the 10-day penicillin V, the respective findings were 33 percent for children younger than 2 years and 20 percent for those 2 years or older. In the Barnett, Teele, Klein, et al. (1997) study, those identified as otitis prone had a failure rate of 24 percent in the ceftriaxone group and a 23 percent failure rate in the trimethoprim-sulfamethoxazole group. The respective numbers for the patients who were not otitis prone were 26 percent and 19 percent. The data suggests that the otitis-prone status of the child did not have an effect on the outcome of failure at 14 days (Barnett, Teele, Klein, et al., 1997).
It is difficult to come to conclusions about the natural history of AOM without intervention because of the few studies available -- less than half are of adequate quality and most of the literature lacks uniformity in the definition of outcomes, the specific outcomes monitored, and the time of measurement. In addition, most of the studies did not report results, including adequate information on denominators, stratified by the influencing factors of age and otitis-prone state, thought to be of importance by the Technical Expert Panel. The studies eligible for the natural history question represent a heterogeneous collection of investigations with respect to the primary influencing factors of age and otitis-prone state. Most of the studies report close followup of patients and clinical criteria for administering antibiotics to the placebo or observational group in the case of persistent or worsening symptoms or complications. Few patients in the placebo or observational groups appeared to require antibiotics.
Clinical failure rate at 24-48 hours was 7.7 percent for nonsevere cases of AOM not treated with antibiotics in the study by Kaleida, Casselbrant, Rockette, et al. (1991); at 24-72 hours, clinical failure occurred in 26 percent of children with AOM not treated with antibiotics in Halsted, Lepow, Balassanian, et al. (1968). Pooling the data on failure rates from 4 to 7 days yielded an estimate of 22.2 percent (three studies; 220 children; 95 percent CI, 10.1 percent and 34.3 percent); that is, 77.8 percent of these children not initially treated with antibiotics for AOM would have clinical resolution. The pooled estimate for failure from 1 to 7 days yielded an estimate of 18.9 percent (five studies; 739 children; 95 percent CI, 9.9 percent and 28.0 percent); that is, 81.1 percent of these children would have clinical resolution. Rosenfeld (1999a) had estimated that 73 percent of children with AOM not initially treated with antibiotics would have clinical resolution by 7-14 days after diagnosis. Failures as defined by recurrences and other factors, including presence of serous otitis media in one study (Townsend, 1964), may accrue up to a year from the onset of the initial episode of AOM; those estimates were as low as 5.8 percent in the cohort study by Townsend (1964) and as high as 27.1 percent in the randomized controlled trial by Kaleida, Casselbrant, Rockette, et al. (1991). The proportion with pain and fever in children with AOM not treated with antibiotics decreased rapidly in the time periods reported. Van Buchem, Dunk, van't Hof, et al. (1981) reported 28 percent had pain after 24 hours, and Burke, Bain, Robinson, et al. (1991) reported that 48 percent had pain at 2 days. At 5-7 days, 25 percent (Burke, Bain, Robinson, et al., 1991) reported pain and at more than 7 days, 10 percent of children still reported pain (van Buchem, Dunk, van't Hof, et al., 1981.) A similar discrepancy in findings existed for the presence of fever: 0 percent at 2-7 days (Howie and Ploussard, 1972), and 20 percent at 2 days, and 11 percent at 5-7 days (Burke, Bain, Robinson, et al., 1991).
In studies reporting on pain or fever, most children with AOM were without either symptom by 3 days (Appleman, Claessen, Touw-Otten, et al., 1991; Kaleida, Casselbrant, Rockette, et al., 1991; Mygind, Meistrup-Larsen, Thomsen, et al., 1981; van Buchem, Dunk, van't Hof, et al., 1981). As estimated by Rosenfeld (1999a), the pooled data indicate that 59 percent (three studies; 315 children; 95 percent CI, 53 percent and 65 percent) of children not treated with antibiotics did not have pain or fever within 24 hours of diagnosis of AOM, 87 percent (five studies; 808 children; 95 percent CI, 84 percent and 89 percent) of children did not have pain or fever by 2-3 days, and 88 percent (five studies; 503 children; 95 percent CI, 85 percent and 91 percent) of children did not have pain or fever by 4-7 days.
Asymptomatic middle ear effusion was confirmed as a common condition following AOM in children not treated with antibiotics. At 3 months, the cited studies show 24 percent (Mygind, Meistrup-Larsen, Thomsen, et al., 1981) and 28 percent (Burke, Bain, Robinson, et al., 1991) of children with middle ear effusion. The evidence suggests that younger children compared with older children had a greater likelihood of failing to meet the definitions of clinical success or resolution when not treated with antibiotics for AOM. The threshold appears to be sometime around 2-3 years of age based on the studies of Laxdal, Merida, and Jones (1970) and Kaleida, Casselbrant, Rockette, et al. (1991). Only one study looked at the possible effect of otitis-prone state (defined as more than two episodes of prior AOM) and found little difference in rates of treatment failure at 1-week evaluation (Burke, Bain, Robinson, et al., 1991). The one study that looked at age and resolution of pain and fever suggests a significant association with age: 58 percent of those under 2 years of age with pain or fever at more than 3 days compared with 7 percent of children 2 years or older among those not treated with antibiotics for AOM (Appelman, Claessen, Touw-Otten, et al., 1991). In the one study that looked at the presence of middle ear effusion in relation to age in children with AOM not treated with antibiotics, the findings suggest a greater propensity to middle ear effusion with younger age (Kaleida, Casselbrant, Rockette, et al., 1991).
The available evidence on natural history of AOM shows that few episodes of mastoiditis or other suppurative complications were reported in children with AOM not initially treated with antibiotics. It is important to note that the children in these studies had close followup and intervention as appropriate. In these studies, the number of suppurative complications reported was comparable whether or not the child was initially treated with antibiotic.
Del Mar, Glasziou, and Hayem (1997) found favorable rate differences in the children with AOM treated with antibiotics in terms of pain at 2-7 days (41 percent) (95 percent CI, 14 percent and 60 percent), and contralateral otitis media (43 percent) (95 percent CI, 9 percent and 64 percent). They did not find any differences in pain at 24 hours, tympanic membrane perforation, vomiting/diarrhea/rash, 1-month tympanometry, or recurrent AOM. Rosenfeld, Vertrees, Carr, et al. (1994) found a rate difference of 12.9 percent (95 percent CI, 8.2 percent and 19.2 percent) in favor of children with AOM treated with aminopenicillins compared with those not treated with antibiotics, and 13.7 percent (95 percent CI, 8.2 percent and 19.2 percent) in favor of children treated with any antibiotic compared to no antibiotic. Rosenfeld (1999a) found that pain and fever relief at 24 hours was not related to antibiotic use in children with AOM (rate difference of 0 percent, 95 percent CI, −7 percent and 8 percent), but pain and fever relief at 2 days was improved by 4 percent (95 percent CI, 2 percent and 7 percent) with antibiotic use. The difference in pain and fever relief at 4-7 days, however, was not significant. Clinical resolution at 7-14 days was 13 percent (95 percent CI, 8 percent and 19 percent) higher in those on antibiotics vs. those not on antibiotics.
The present analysis adds to the prior meta-analytic studies (Del Mar, Glasziou, and Hayem, 1997; Rosenfeld, 1999b; Rosenfeld, Vertrees, Carr, et al., 1994) by assessing the efficacy of specific antibiotics. Because of differences in definitions of treatment failure and the units of analysis, sensitivity analyses were performed, and the results indicate that ampicillin or amoxicillin was beneficial in the treatment of AOM compared with placebo (with pooled rate differences of −9.7 percent to −12.9 percent). The results were generally insensitive to the studies included, except that as the number of studies decreased, the 95 percent confidence limits increased. About eight children with AOM would need to be treated with ampicillin or amoxicillin to prevent a case of clinical failure. Subgroup analyses based on age or otitis-prone status were not possible.
Other treatment regimens we compared to placebo or observational treatment included: amoxicillin-clavulanate, pencillin G plus sulfisoxazole, penicillin V, erythromycin estolate, triple sulfonamide, and erythromycin estolate plus triple sulfonamide.
In general, there appears to be a trend of modest improvement in specific outcomes with antibiotic administration compared to placebo or observational treatment in terms of pain and fever and other symptom resolution and presence of exudate. No statements can be made regarding the effect of age or otitis-prone status on these comparisons.
The results of the three individual studies showed a pooled rate difference minimally favoring ampicillin or amoxicillin compared with penicillin, although each was statistically insignificant. The quantitative synthesis affirms that the effects of penicillin and ampicillin or amoxicillin on treatment of AOM are not different based on these three studies. The three studies do not allow for subgroup meta-analysis of the data by age or otitis-prone status, although data from one of the studies suggests that ampicillin may be more effective than penicillin in children under 6 years of age (Laxdal, Merida, and Jones, 1970). Another study suggests that ampicillin was more effective than penicillin if Haemophilus influenzae grew from culture (Nilson, Poland, Thompson, et al., 1969), but this finding must be tempered by the fact that this study was conducted 30 years ago -- before the recent rise in bacterial resistance to antimicrobial agents.
The meta-analyses looking at cefaclor vs. ampicillin or amoxicillin show statistically insignificant rate differences in terms of failure at 3-7 days and at 5-21 days. This finding is in accord with the results of the individual studies. One study suggests that this finding also is true in infants 1-3 months of age (Berman and Lauer, 1983). The reported data from these five studies, however, do not allow for any further subgroup analysis on age or otitis-prone status.
The meta-analyses comparing cefixime to ampicillin or amoxicillin demonstrate insignificant rate differences with respect to failure at 10-15 days, recurrence rate at 3-5 weeks, incidence of vomiting, and incidence of rash. The incidence of diarrhea was higher among those on cefixime and was statistically significant. Twelve children with AOM would need to be treated with ampicillin or amoxicillin rather than cefixime to avoid a case of diarrhea. Subgroup analysis based on age or otitis-prone status was not possible using these five studies.
None of the following antibiotics showed any difference in failure rates measured at various points in time compared with ampicillin or amoxicillin: cephalexin, cephradine, cerufoxime-axetil, ceftriaxone, loracarbef, erythromycin-estolate, erythromycin-ethylsuccinate, clarithromycin, clindamycin, triple sulfonamide, penicillin G plus sulfisoxazole, penicillin V plus sulfisoxazole, penicillin V plus triple sulfonamide, procaine-penicillin-benthazine-penicillin G plus sulfisoxazole, erythromycin-ethylsuccinate-sulfisoxazole, erythromycin-ethylsuccinate-acetyl-sulfafurazole, and erythromycin-sulfisoxazole. This also was true in the one study that stratified the outcome by age, but the numbers were very small in that comparison. None of the studies stratified by otitis-prone status.
No difference was seen between cefaclor and trimethoprim-sulfamethoxazole in terms of failure at less than 14 days of treatment. No comment can be made regarding the role of age or otitis-prone state.
No difference was seen based on the few studies that studied the comparisons of amoxicillin-clavulanate and ceftriaxone with trimethoprim-sulfamethoxazole.
No studies were available that compared oral fluoroquinolone with another antibiotic for the treatment of AOM in children.
In the single study on high-dose amoxicillin-clavulanate vs. standard-dose of the same antibiotic, no difference in effectiveness could be demonstrated. We note, however, that showing a lack of difference is not the same as establishing equivalence of effect. No comment can be made on the influence of age or otitis-prone status.
In the single study on high-dose amoxicillin prescribed twice a day vs. three times a day, no difference in effectiveness could be demonstrated. We note, however, that showing a lack of difference is not the same as establishing equivalence of effect. Although the authors comment that age and the number of previous episodes of AOM had no influence on the outcomes, the data were not presented; therefore, we can not comment directly on the influence of these factors.
No difference in failure rate at 5-10 days was found comparing single-injection ceftriaxone with 7-10 days of amoxicillin therapy for the treatment of AOM.
No difference in failure rate at 10-14 days was found in comparing less than 5-day azithromyicn therapy to 7-10 days of amoxicillin-clavulanate therapy.
Amoxicillin-clavulanate was associated with a statistically greater proportion of adverse effects, predominantlygastrointestinal effects, compared with azithromycin therapy. Eight children would need to be treated with azithromycin rather than amoxicillin-clavulanate to avoid a case of diarrhea. (Although not reported in the studies, the clavulanate concentration was most likely 31.25 mg per 125 mg of amoxicillin.) These meta-analyses, however, were associated with significant statistical heterogeneity. The source of that heterogeneity is not clear.
We compared the following antibiotic treatments: penicillin V (<5 days) vs. penicillin V (7-10 days), penicillin V (5 days) vs. penicillin V (7-10 days), benthazine penicillin G (one dose) vs. tetracycline (7-10 days), benthazine penicillin G (one dose) vs. benthazine penicillin (one dose) plus triple-sulfonamide (7 days), amoxicillin-clavulanate (5 days) vs. amoxicillin-clavulanate (7-10 days), cefaclor (<5 days) vs. cefaclor (7-10 days), cefaclor (5 days) vs. amoxicillin (7-10 days), cefaclor (5 days) vs. cefaclor (7-10 days), cefuroxime-axetil (5 days) vs. amoxicillin-clavulanate (7-10 days), cefuroxime-axetil (5 days) vs. cefxime (7-10 days), cefpodoxime-proxetil (5 days) vs. amoxicillin-clavulanate (7-10 days), cefpodoxime-proxetil (5 days) vs. cefaclor (7-10 days), cefpodoxime-proxetil (5 days) vs. cefixime (7-10 days), cefprozil (5 days) vs. cefprozil (7-10 days), ceftriaxone (one dose) vs. amoxicillin-clavulanate (7-10 days), ceftriaxone (one dose) vs. cefaclor (7-10 days), ceftriaxone (one dose) vs. cefuroxime-axetil (7-10 days), azithromycin (<5 days) vs. cefaclor (7-10 days), and azithromycin (<5 days) vs. clarithromycin (7-10 days).
The majority of studies of these treatments -- 19 of 24 -- show no difference in effectiveness between the short-duration and long-duration therapies evaluated. Only two of these studies looked at the effect of age on outcome, and only one looked at the effect of otitis-prone status on outcome. Paradise (1997) reported results suggesting that clinical failure at 12-14 days and 32-38 days was significantly higher for children younger than 2 years old and at 12-14 days for children 2-5 years old in the 5-day amoxicillin-clavulanate group than the group taking amoxicillin-clavulanate twice a day for 10 days. Ingvarsson and Lundgren (1982) reported results suggesting that although the difference in failure was not significant between the short-duration penicillin and long-duration penicillin groups in general, there appeared to be a higher percentage of failure in the short-duration group of those younger than 2 years of age. Barnett, Teele, Klein, et al. (1997) reported that otitis-prone status did not seem to have an effect on failure rate, but those who failed appeared to be of younger mean age. The former two studies suggest that age may be an important influencing factor to consider when prescribing shorter-duration antibiotic therapy for AOM.
| Comparison | Meta-analysis | Rate Difference in % (95% CI) | Test of Heterogeneity | Number Needed to Treat (NNT) (95% CI) | |
|---|---|---|---|---|---|
| Q-Value | P-Value | ||||
| 1 (Q3) Ampicillin or Amoxicillin vs. Placebo | 1.1 Failure rate at 2-7 days of treatment (5 studies) | −12.3 (−21.8, −2.8) | 18.83 | 0.002 | −8 (−36, −5) |
| 1.2 Failure rate at 2-7 days of treatment, excluding Howie studies (4 studies) | −9.7 (−19.2, −0.2) | 13.71 | 0.003 | −10(−437, −5) | |
| 1.3 Failure rate at 2-7 days of treatment, excluding Howie and Kaleida studies (3 studies) | −12.9 (−27.5, 1.7) | 5.89 | 0.053 | ND | |
| 2 (Q4a) Penicillin vs. Amoxicillin or Ampicillin | 2.1 Failure rate at 7-14 days of treatment (3 studies) | 4.5 (−1.8, 10.7) | 1.97 | 0.374 | ND |
| 3 (Q4a) Cefaclor vs. Amoxicillin or Ampicillin | 3.1 Failure rate at 3-7 days post treatment (4 studies) | −5.4 (−15.2, 4.4) | 3.05 | 0.383 | ND |
| 3.2 Failure rate at 5-21 days post treatment (5 studies) | 0.5 (−5.7, 6.8) | 3.16 | 0.531 | ND | |
| 4 (Q4a) Cefixime vs. Amoxicillin or Ampicillin | 4.1 Failure rate at 10-15 days of treatment (4 studies) | −0.1 (−4.2, 3.9) | 0.21 | 0.976 | ND |
| 4.2 Recurrence rate at 3-5 weeks of treatment (3 studies) | 1.6 (−5.1, 8.4) | 0.37 | 0.832 | ND | |
| 4.3 Incidence of diarrhea (5 studies) | 8.4 (3.8, 13.1) | 2.95 | 0.567 | 12 (8, 27) | |
| 4.4 Incidence of vomiting (5 studies) | 2.0 (0.0, 4.0) | 3.79 | 0.435 | ND | |
| 4.5 Incidence of rash (4 studies) | 5.8 (−2.4, 13.9) | 12.11 | 0.007 | ND | |
| 9 (Q4e) Ceftriaxone (1 dose) versus Amoxicillin (7-10d) | 9.1 Failure rate at 5-10 days of treatment (3 studies) | 3.4 (−1.6, 8.5) | 0.30 | 0.862 | ND |
| 9.2 Failure rate at 5-10 days of treatment (criterion of failure is relaxed to include complications in Green study). | 2.5 (−4.4, 9.5) | 0.51 | 0.775 | ND | |
| 10 (Q4e) Azithromycin (<5d) versus Amoxicillin-Clavulanate (7-10d) | 10.1 Failure rate at 10-14 days of treatment (5 studies) | 2.1 (−0.6, 4.8) | 5.34 | 0.254 | ND |
| 11 (Q4e) Azithromycin (5d) versus Amoxicillin-Clavulanate (7-10d) | 11.1 Any mention of adverse events (3 studies) | −19.2 (−29.2, −9.2) | 12.49 | 0.002 | −5 (−11, −3) |
| 11.2 GI related adverse events (3 studies) | −18.0 (−28.0, −8.0) | 13.48 | 0.001 | −6 (−13, −4) | |
ND=Not Done due to non-significant result.
In children not initially treated with antibiotics, clinical failure at 24-48 hours was 7.7 percent in one study (i.e., 92.3 percent clinical resolution), and 26 percent at 24-72 hours in another study (i.e., 74 percent clinical resolution). The pooled estimate for clinical failure at 1-7 days was 18.9 percent (95 percent CI, 9.9 percent and 28.0 percent) and for 22.2 percent at 4-7 days (95 percent CI, 10.1 percent and 34.3 percent).
A previous information synthesis estimated that 59 percent (95 percent CI, 53 percent and 65 percent) of children not treated with antibiotics had resolution of pain and fever within 24 hours of AOM diagnosis, 87 percent (95 percent CI, 84 percent and 89 percent) of children had resolution of pain and fever by 2-3 days, and 88 percent (95 percent CI, 85 percent and 91 percent) of children had resolution of pain and fever by 4-7 days.
The available evidence on natural history of AOM shows that in studies with close followup, few episodes of mastoiditis or other suppurative complications are reported in children with AOM not initially treated with antibiotics.
Antibiotics in comparison to placebo or observational treatment may have a modest benefit on symptom resolution and failure rates, as variously defined, in children with AOM. For example, about eight children with AOM would need to be treated with ampicillin or amoxicillin rather than no antibiotic treatment to avoid a clinical failure.
Previous meta-analyses have demonstrated minimal to modest benefits of antibiotics compared to observational intervention without antibiotics during the initial treatment of AOM for pain and fever resolution at 2 days, pain resolution at 2-7 days, contralateral otitis media, and clinical resolution rate at 7-14 days. Pain resolution at 24 hours, pain and fever resolution at 4-7 days, tympanic membrane perforation, vomiting/diarrhea/rash, 1-month tympanometry, and recurrent AOM did not appear to be affected by antibiotic use.
The study was not able to demonstrate any clinical benefits of other antibiotics in comparison with ampicillin or amoxicillin and to trimethoprim-sulfamethoxazole. However, cefixime was shown to cause greater incidence of diarrhea than ampicillin or amoxicillin. Twelve children would have to be treated with ampicillin or amoxicillin rather than cefixime to avoid a case of diarrhea.
No comment can be made on the marginal effect of oral fluoroquinolones compared with other antibiotics in the treatment of AOM.
Although not establishing equivalency of effect, a single study was unable to demonstrate a difference in clinical effect of high-dose amoxicillin-clavulanate vs. standard-dose amoxicillin-clavulanate.
Although not establishing equivalency of effect, a single study was unable to demonstrate a difference in clinical effect of taking high-dose amoxicillin two times a day vs. three times a day.
We could not demonstrate any difference in clinical failure rates between short-duration therapy and long-duration therapy of AOM. A previous meta-analysis demonstrated that short-acting antibiotic therapy of less than 2 days was not as effective as therapy that lasted 7 days or longer.
Azithromycin given for 5 days led to fewer adverse events, particularly gastrointestinal, than 7-10 days of amoxicillin-clavulanate. Eight children with AOM would need to be treated with azithromycin rather than amoxicillin-clavulanate to avoid a gastrointestinal adverse event. (Although not reported in the studies, the clavulanate concentration was most likely 31.25 mg per 125 mg of amoxicillin, i.e., original formulation.)
Estimates generated by quantitative synthesis are subject to error. The issue of heterogeneity is always open to question, particularly with regard to study subjects and treatment regimens. The definitions of AOM found in the studies varied as did the diagnostic criteria in terms of establishing the presence of middle ear effusion, rapid onset, and specific signs and symptoms and in establishing an initial or new episode of AOM. Very few studies rated the severity of AOM. In this evidence-based analysis, the choice of outcomes and the definition of clinical failure also varied from one study to another. Statistical heterogeneity characterized several of our meta-analytic comparisons. We used the random effects model in all cases to provide a more conservative estimate of significance.
Another problem was that most of the studies in this evidence-based analysis had small numbers of subjects. For the most part, the individual studies were unable to establish the significance of any treatment effects seen. Among the antibiotic regimen comparisons, less than 10 percent appeared to be of sufficient statistical power to detect a difference. Relevant to this study, Pogue and Yusuf (1998) pointed out that meta-analysis of trials with small subject numbers may overestimate treatment effects.
Although we are confident that the literature search for this report was thorough, it is possible that some studies were missed, particularly with regard to the comparative analysis of antibiotic treatments. Our search of the non-English literature, which ended with a screening and review of those non-English reports found in five of the seven databases, was not exhaustive. Although that search yielded only two studies, it is possible that non-English citations from other sources may have yielded further studies for the analysis.
Studies of poor quality, particularly those with inadequate randomization procedures or those not double-blind, may inflate estimates of treatment benefit (Moher, Jones, Cook, et al., 1998; Schulz, Chalmers, Hayes, et al., 1995). Although all of the studies included in the meta-analyses were randomized, many studies did not adhere to protocols that would strengthen the internal validity of the findings. Because many of the studies did not report their procedures for randomization, it is difficult to determine whether the randomization process was appropriate in those trials. A large number of studies also were not double-blind. About one-half of the studies were not of adequate quality based on the Jadad scale. Because of the small numbers of studies in each of our meta-analyses, the sensitivity analysis we had planned was not possible.
The generalizability of the findings of this evidence-based analysis is difficult to assess. Looking at the natural history studies, we previously noted the wide range in percentage of subjects 2 to 2-and-a-half years old or younger reported in both the randomized controlled trials and the cohort studies. Only two of the nine randomized controlled trials addressing natural history reported any outcome stratified as 2 years or younger and older than 2 years (Appelman, Claessen, Touw-Otten, et al., 1991; Kaleida, Casselbrant, Rockette, et al., 1991), and only the Kaleida, Casselbrant, Rockette, et al. (1991) study reported early failure rate stratified in this manner. Two of the six cohort studies on natural history reported results stratified for younger and older than 2 years of age (Froom, Culpepper, Grob, et al., 1990; Tilyard, Dovey, and Walker, 1997), with clinical failure rates at 2 months and 1 month, respectively.
One might assume that results stratified by age were not reported because there was no difference, but we hesitate to make this presumption as the two studies that do report by age indicate that children younger than 2 years old do not resolve their clinical symptoms as quickly as older children. On the other hand, we also would not make any conclusions based only on these two studies because one was of very small sample size (Appelman, Claessen, Touw-Otten, et al., 1991) and the other studied children with nonsevere AOM in the placebo group (Kaleida, Casselbrant, Rockette, et al., 1991), using episodes as the unit of analysis.
The question on antibiotics vs. no antibiotics used the same randomized controlled trials just described and, thus, have the same difficulties with reporting outcomes by age. The studies on the clinical effectiveness of specific antibiotic regimens suffer the same problems with regard to reporting outcomes by subject age. We have reported in the individual results sections the wide range in percentage of subjects 2-3 years old or less. In the studies on ampicillin or amoxicillin or trimethoprim-sulfamethoxazole vs. other antibiotics, three studies report outcomes on children younger than 2 years old, one exclusively studying infants younger than 3 months old and another exclusively children younger than 2 years old. Four of the studies on short-duration vs. long-duration therapy of AOM report on age-stratified outcomes. Although the study by Brodie, Griggs, and Cunningham (1990) showed no difference in 1-to 4- day clinical failure rates in those younger and older than 2 years old (all on antibiotics) we cannot presume that results by age were not reported because there were no differences. For example, the Hoberman, Paradise, Burch, et al. (1997) study did not report any outcomes by age in their initial article, but later in an editorial, one of the investigators reported clinical cure or improvement rates at 12-14 days and 32-38 days, suggesting that children younger than 2 years do not do as well as older children (Paradise, 1997). Unfortunately, this investigator did not report on those younger than 2 years old in a third treatment arm of that study.
The remaining three studies also suggest higher clinical failure rates in children younger than 2 years old on antibiotics (Ingvarsson and Lundberg, 1981; Principi, 1995; Schaad, 1993). Most of the studies did not address the otitis-prone status of the child, and even fewer reported outcomes stratified by this influencing factor. Appleman, Claessen, Touw-Otten, et al. (1991) was an exception because this study recruited only patients with recurrent otitis media into their trial. Although many studies had significant numbers of children younger and older than 2 years, we cannot generalize the findings of this study to children in specific age groups because most of the studies did not report outcome by age. Several studies suggest greater caution be taken with children younger than 2 years old; however, these studies do not definitively answer this question. Similarly, we cannot generalize the study findings to children by otitis-prone status.
Two other issues -- although not specifically cited for assessment in the present analysis by the Technical Expert Panel -- that may be significant influencing factors are the degree of severity of AOM and increasing bacterial resistance to antibiotics. Kaleida, Casselbrant, Rockette, et al. (1991) was one of the few studies that explicitly defined severity and treated those with low severity and high severity with different therapeutic regimens. Many of the studies excluded those children with AOM that one might label high severity (i.e. those with complications, comorbid or concurrent conditions, or strong indications for antibiotic). In addition, many of the studies excluded children with acute or chronic perforation of the tympanic membrane. The study findings are, therefore, most applicable to children with AOM of lesser severity without comorbidities.
The majority of studies in this evidence-based analysis do not explicitly address the issue of bacterial resistance. As Klein (1998) notes, group A streptococci and streptococcus pneumonia developed resistance to sulfonamides in the 1940s; Staphylococcus aureus to penicillins, macrolides, and tetracyclines in the 1950s; gram-negative enteric bacilli to aminoglycosides, chloramphenicol, and tetracyclines in the 1960s; Haemophilus influenzae to beta-lactamase-susceptible penicillins in the 1970s; and more recently, S. pneumonia to penicillins, cephalosporins, and macrolides in the 1980s.
Our study did not look at the issue of bacterial resistance and its effect on outcome of AOM. It might have been possible to stratify the studies based on the decade of conduct as a proxy to bacterial resistance pattern, but the prevalence of bacterial resistance also may differ based on locale (McCracken, 1998). A consensus conference convened by the Centers for Disease Control and Prevention has made recommendations with regard to treatment of AOM in light of this issue (Dowell, Butler, Giebink, et al., 1999).
Outcomes measured varied in studies, making comparison difficult. In addition, similar outcomes were defined differently in studies. Most of the clinical outcomes measured were short term rather than long term. The studies in this analysis did not address speech and language development, an obvious long-term outcome. Some of the studies measured adverse effects such as rash, diarrhea, and vomiting. Studies tended to concentrate on clinical outcomes. The studies do not measure the costs and benefits to the family and to society of AOM treatment alternatives.
Another influencing factor that was not controlled in any of the studies in the present evidence-based analysis was the use of antipyretics and analgesics by the study subjects. The investigators should control the use of antipyretics and analgesics in some manner, especially in cases when fever and otalgia or pain are outcome measures.
Randomized controlled studies of high internal validity and adequate generalizability are still needed to adequately assess the key questions asked at the start of this systematic review. There is still a need to adequately address the role of antibiotics in the initial treatment of AOM in children compared to placebo or observational treatment, especially in terms of various influencing factors such as age and otitis-prone status. Close monitoring of patients in these studies with a priori plans for appropriate intervention should allay any concerns about suppurative complications and should also be a focus of research. Strong consideration should be given to establishing uniform criteria -- based on bacterial spectrum, pharmacokinetics, bioavailability, minimum inhibitory concentrations to specific bacteria, and other relevant factors, including cost -- to guide investigators in the comparison of antibiotics. In addition, bacterial resistance is an increasingly important factor and should be considered in future studies comparing antibiotics with one another in treating AOM.
It is critical to establish a definition of AOM that is acceptable to both researchers and practitioners. The diversity of definitions that presently exists makes it difficult to generalize findings or to apply findings to specific patient populations. The tasks in this area are to determine what terms are needed and uniform definitions for those terms. Accuracy of diagnosis also must be investigated and is an important research issue because comparability of assessment across studies depends on accuracy of diagnosis as the primary inclusion criteria for subject recruitment. In addition, all terms describing the specific structures, processes, and outcomes related to the management of AOM must be defined to facilitate rational decisionmaking with respect to this clinical condition.
Future studies on antibiotics in the treatment of AOM should strengthen the factors related to the internal validity of the studies. In particular, assignment of subjects to treatment groups should be performed using appropriate methods of randomization. Studies also should be conducted in a double-blind fashion: this is a particular weakness in the studies in this evidence-based analysis. Relative to both these issues is the maintenance of allocation concealment. Studies should account for all subject withdrawals and use appropriate denominators in analysis.
Editors of study reports should require that documentation of studies allow the reader to readily assess the internal validity of the study. Several groups, culminating in the Consolidated Standards of Reporting Trials discussions, have recommended guidelines for reporting controlled trials (Begg, Cho, Eastwood, et al., 1996), and controlled trials on AOM should follow these guidelines for reporting. Improved reporting on subject characteristics, treatment description, and outcome definition would increase the generalizability of findings and improve the entire process of evidence synthesis used in this report.
The issue of subject selection must be a conscientious balance between the generalizability of findings and the applicability of findings to specific patients or patient populations rather than a matter of convenience, even in the setting of a randomized controlled trial.
Future studies should try to include sufficient numbers of subjects in randomized controlled trials to allow generalization of the findings to other patient populations. Future studies also should include sufficient variation in study population to evaluate important influencing factors such as age and otitis-prone state. The data should be available for secondary analysis to provide results that may be more applicable to more specific patient populations (e.g., based on age or otitis-prone status).
In future studies, outcomes should be defined in detail; agreed upon by researchers, practitioners, and patients; and adhered to in all forms of communication to promote rational discussions of the treatment of AOM. All outcomes should be uniformly measured in all studies on AOM as the resources of the investigator allow. They also should be prioritized so that investigators with limited resources can decide which outcomes to measure. If pain and fever remain as relevant AOM outcomes, the effect of analgesics and antipyretics also should be considered. Future studies should assess the long-term outcomes of AOM, as well as the short-term outcomes that most studies presently concentrate on. To make informed decisions in the treatment of AOM, information must be available on all relevant outcomes and not just those that are most convenient to measure. Because bacterial resistance to antibiotics is growing, bacteriologic outcomes should be considered along with clinical outcomes. Finally, future studies are needed to assess the cost-effectiveness of alternative treatments of AOM using a societal perspective that looks at direct and indirect costs and also incorporates the viewpoint of the patient and family and measures of quality of life and functional status.
AAA: American Academy of Audiology
AAHP: American Association of Health Plans
ABX: antimicrobial
AHCPR: Agency for Health Care Policy and Research
AHRQ: Agency for Healthcare Research and Quality
AMP: ampicillin
AMX: amoxicillin
AOM: acute otitis media
AOME: acute otitis media with effusion
APA: Ambulatory Pediatric Association
BID: two times a day
CBA: cost-benefit analysis
CEA: cost-effectiveness analysis
CFC: cefaclor
CFX: cefixime
CI: confidence interval
CINAHL: Cumulative Index to Nursing and Allied Health Literature
CLV: clavulanate
DARE: Database of Abstracts of Reviews of Effectiveness
DZ: disease
EES: erythromycin ethylsuccinate
ENT: ear, nose, and throat
EPI: episode
ER: emergency room
ERY: erythromycin
FACCT: Foundation for Accountability
GI: gastrointestinal
HMO: health maintenance organization
HZ: history
ICE: incremental cost effectiveness
IPA: International Pharmaceutical Abstracts
ME: middle ear
MEE: middle ear effusion
NAMCS: National Ambulatory Medical Care Survey
NAPNAP: National Association of Pediatric Nurse Associates and Practitioners
NHAMC: National Hospital Ambulatory Medical Care Survey
NHIS: National Health Interview Survey
NNT: number needed to treat
OM: otitis media
OR: odds ratio
PCN: penicillin
PE: pressure equalization
PMEE: persistent middle ear effusion
PPO: preferred provider organization
QALY: quality-adjusted life-years
QID: four times a day
RCT: randomized controlled trial
RR: relative risk
RX: prescription
SENTAC: Society for Ear, Nose, and Throat Advances in Children
SSX: sulfisoxazole
TID: three times a day
TMP-SMX: trimethoprim-sulfamethoxazole
TX: treatment
UI: unique identification
URI: upper respiratory infection
| Study | Definition of Illness | Age Group | Date of Estimate | National Cost Estimate (Billions) | Approximate National Cost in 1995 Prices (Billions) 2 |
|---|---|---|---|---|---|
| Stool and Field (1989) | Otitis media | 0-6 years | 1987 1 | $2.2-$3.4 | $4.05-$5.58 |
| Berman, Byrns, Bondy, et al. (1994) | Persistent middle ear effusion | 0-1 years | 1992 | $1.37-$4.92 3 | $1.59-$5.71 4 |
| Stool, Berg, Berman, et al (1994) | Otitis media with effusion | 2 years | 1991 | $1.09 | $1.49 4 |
| Gates (1996b) | Acute otitis media | 0-4 years | 1994 1 | $3.15 | $3.49 |
| This report | Acute otitis media | 0-17 years | 1995 | $2.98 | $2.98 |
Date not specified by author(s).
Inflated as possible by components of the Consumers Price Index and the Employment Cost Index.
Inferred from authors' findings.
No separate adjustments for medical and non-medical components of costs.
As the table indicates, the four estimates of the national cost burden differed with respect to definition of illness and age group for which costs were derived. They also differed with respect to specification of the scope of costs and the pricing of cost components. The estimates are described in detail in the following attachment to this appendix.
At the conclusion of the literature review, the annual national cost of AOM in children younger than18 years of age was estimated from existing data summaries and published reports of costs and utilization per episode of illness. Because of the dearth of usable epidemiological and cost-related data, it was necessary to employ a number of assumptions to derive the cost estimate. The principal features and underlying assumptions of the estimate are the following: Otitis media with effusion (OME) and chronic (or persistent or recurrent) middle ear infections were considered possible complications of AOM or the results of unsuccessful treatment of AOM. Because the costs of complications of an illness and of treatment failures are conventionally and correctly regarded as costs of the illness, the cost of episodes of OME/chronic middle ear infection that follow episodes of AOM was considered a cost of AOM. National illness costs were derived for the year 1995. Certain data used in deriving and validating the estimates were not yet available for 1996 and later years when the report was begun. The cost estimate was constructed to be as consistent as possible with published data on national medical care utilization for middle ear infections.
The estimated direct cost of AOM was $1.96 billion (65.8 percent of the total) in 1995, and the estimated indirect cost was $1.02 billion (34.2 percent of the total). The large percentage of indirect costs in the total suggests that AOM imposes a considerable economic burden on patients' families.
Medical care prices rose 12.5 percent from 1995 to the first quarter of 1999 and workers'earnings per hour rose 14.7 percent. Applying these inflators to the estimates of direct and indirect costs suggests that the annual national cost of OM increased to $3.38 billion in early 1999 because of price increases alone.
Seventy percent of the direct cost of AOM and 63 percent of the total cost was attributable to episodes of OME/chronic middle ear infection progressing from AOM. These figures imply that effective treatments for AOM and prevention of subsequent infection would achieve significant national cost savings.
The analytic procedure produced an estimate of 5.18 million treated episodes of AOM in 1995, 2.22 million treated episodes of OME/chronic middle ear infection, and 1.04 million episodes of treated OME/chronic middle ear infection assumed to be progressions or complications of AOM. Although these values were constrained to yield national ambulatory care visit totals reported by NAMCS, the estimated total number of episodes of OM, 7.40 million, is smaller than the number conjectured in other cost estimates.
Insofar as it is comparable to it, the cost estimate itself is smaller than the estimated cost of AOM assumed by Gates (1996b). The lower value is due partly to the generally conservative assumptions used here and partly to what seems to be an exaggerated estimate of the annual prevalence of AOM used by Gates.
The cost estimates have important limitations, primarily due to conflicting epidemiological evidence regarding the prevalence of AOM and OME. In particular:
The annual national numbers of ambulatory care visits for OM implied by epidemiological studies of OM are 50 percent or higher than national visit totals reported from NAMCS and the National Hospital Ambulatory Medical Care Surveys (NHAMCS). Because the epidemiological studies were conducted in small geographic areas and nearly all of them were performed before 1990, it was considered that NAMCS and NHAMCS data yielded more reliable estimates of the national prevalence of OM than the epidemiological literature. However, it has been claimed -- although without hard supporting evidence -- that NAMCS reports understate the true national visit totals (Glass, Lew, Gangarosa, et al., 1991). If the claim is true, the national cost estimate is biased downward.
To deduce the annual numbers of episodes of AOM and OME/chronic middle ear infection following AOM in the under-18-year-old age group from NAMCS and NHAMCS data, it was necessary to employ two major assumptions. The first was that OME/chronic middle ear infection represents 30 percent of all episodes of OM. The second was that 20 percent of the episodes of AOM progress to OME/chronic middle ear infection. Little empirical evidence exists with which to confirm or reject either assumption.
Sensitivity analyses of the national cost estimate showed that variations of 10 percent in most of the price and utilization parameters changed the estimate by 4 percent or less. However, the cost estimate was sensitive to the assumed national ambulatory care visit total for AOM, the percentage of episodes of OM classifiable as OME/chronic middle ear infection, and the percentage of episodes of AOM that progress to OME/chronic middle ear infection. Sensitivity analyses indicated that plausible values of these three parameters raise the estimated national cost of AOM to as much as $6 billion in 1995 prices. Thus, it is reasonable to believe that the true annual national cost of AOM was $3 billion to $6 billion in 1995.
| Study | Branthaver, Greiner, and Eichelberger (1997) | Landholt and Kotschwar (1994) |
| Authors' definition of illness | Acute otitis media | Acute, nonrecurrent otitis media |
| Methodology | Cost-effectiveness analysis? Unclear. | Cost-minimization analysis |
| Analytic technique | Observed data, decision-analysis model | Retrospective data-based cost and severity of illness analyses |
| Location and date of study | Rockville, MD [2 Kaiser-Permanente (KP) clinics], September-December, 1990 | Location not specified in US, 1991 |
| Perspective | Payer (HMO) | Payer |
| Patient population | Children 0-7 years | Children 6 mo.−12 yr (N=50) |
| Interventions | 5 antibiotic therapy alternatives
| 2 antibiotic therapies:
|
| Dose and schedule | Not specified | AC: 40mg/kg, 3 doses/day, 10 days CP: 10mg/kg, 2 doses/day, 10 days |
| Duration of therapy | Unclear (varies with outcome), up to 8 weeks | Not specified - 14 days (?) |
| Period of observation | 8 weeks | Not specified - 14 days (?) |
| Direct costs | Medications, MD visits | MD visits, medications, antidiarrheals, diapers, electrolytes, antifungals |
| Indirect costs | Excluded | Excluded |
| Source of therapy efficacy estimates | KP records | Authors' data |
| Source of utilization estimates | KP records, authors | Authors' data |
| Source of unit cost estimates | KP records | Authors |
| Definition of health well-being or health outcome | Health outcomes defined only as "cure" and "failure". | Otitis media severity score, clinical cure rate |
| Source of health well-being/health outcome estimates | KP records | Authors' data |
| Treatment side effects considered? | Yes | Yes |
| Baseline results | Few details reported. Observed costs per case of all 5 therapies apparently nonsignificantly different. TS and CM said to be most effective therapies (yield highest cure rates), ES least effective. | Mean direct costs/episode:
|
| Sensitivity analysis results | No sensitivity analysis | No sensitivity analysis |
| Remarks | Little specific information provided by authors. Numerical analysis cannot be verified by readers because of sketchy and incomplete reporting of estimates and statistical tests. | Methodology consistent with pharmacoeconomic standards except for lack of sensitivity analysis and failure to include lost parental work time in cost estimates. Results based on exceptionally small sample. |
| Study | Oh, Maerov, Pritchard, et al. (1996) | Weiss and Melman (1988) |
| Authors' definition of illness | Acute otitis media | Acute otitis media |
| Methodology | Cost-utility analysis | Cost-minimization analysis |
| Analytic technique | Decision-analysis model | Decision-analysis model |
| Location and date of study | Ontario, 1992 | Not stated. US national? 1987-88? |
| Perspective | Not specified -- health insurer/payer? | Patient's family (uninsured) |
| Patient population | Children 2 months - 18 years | Not specified |
| Interventions | Second-line antibiotic therapy, 3 alternatives:
| First-line antibiotic therapy, 2 alternatives:
|
| Dose and schedule | CM: 3 doses/day, 40 mg/kg each AC: 3 doses/day 40 & 10 mg/kg, each ES: 3 doses/day, 50 & 150 mg/kg each | Not specified |
| Duration of therapy | Two courses of medication | Two courses of medication |
| Period of observation | 30 days from first MD visit | Not specified |
| Direct costs | Drug, MD visit, lab tests | Drug, MD visits |
| Indirect costs | Excluded | Parental lost work time |
| Source of therapy efficacy estimates | Literature | Literature |
| Source of utilization estimates | Mail survey of 17 pediatricians | Authors |
| Source of unit cost estimates | Ontario Health Insurance Plan | Authors |
| Definition of health well-being or health outcome | Quality-adjusted life-days (QALDs, Max=30) | None. Patient well-being/health Outcome assumed the same for each treatment alternative. |
| Source of health well-being/health outcome estimates | Patient quality of life estimated by 17 pediatricians in mail survey | NA |
| Treatment side effects considered? | Yes | No |
| Baseline results | Expected QALDs per case and cost per QALD
| Expected costs of AM and CM therapies $68.57 and $72.83 per case. AM therapy the more cost-effective intervention but unclear whether difference in mean costs is statistically significant. |
| Sensitivity analysis | Performed by Monte Carlo simulations. Analysis supports C as most cost-effective intervention. | No sensitivity analysis |
| Remarks | Methodology consistent with pharmacoeconomic standards, but quality of life estimates given by very small sample of MDs. Parents probably better judges of quality of life. | Presentation and discussion of estimates vague. No statistical test of premise that AM and CM are equally effective. No statistical test of equality of costs per case. No sensitivity analysis. |
Except in the broadest terms, the four economic evaluations of antibiotic treatments for AOM have little in common. All four studies were performed using standard decision-analysis or decision-tree models. In three studies, amoxicillin-clavulanate combination therapy was compared with one or more other antibiotic therapies. In the fourth (Weiss and Melman, 1988), amoxicillin monotherapy was compared with cefaclor monotherapy. Three of the four were performed, or seemed to have been performed, from the payer's perspective. The fourth was conducted from the perspective of the child's family under the assumption that the family was uninsured (Weiss and Melman, 1988).
Because payers are usually concerned only with direct costs, the three studies conducted from the health plan payer's perspective excluded indirect care-giving costs, although one of the three presented estimates of hours of lost parental work time caused by care-giving (Landholt and Kotschwar, 1994). Only one study estimated the direct costs of treatment side effects. None of the studies examined or estimated the costs of long-term sequelae of failed treatments such as recurrences of illness, surgery, or patient hearing loss and related learning disabilities. Only one of the three studies performed a sensitivity analysis of the results derived from its model (Oh, Maerov, Pritchard, et al., 1996).
Findings as to the most cost-effective antibiotic therapy for AOM differ. In two studies it was concluded that cefaclor monotherapy was more cost-effective than amoxicillin monotherapy, amoxicillin-clavulanate, and erythromycin-sulfisoxazole (Branthaver, Greiner, and Eichelberger, 1997; Oh, Maerov, Pritchard, et al., 1996). By contrast, amoxicillin monotherapy was judged more cost-effective than cefaclor monotherapy in one of the other two studies (Weiss and Melman, 1988). In the fourth analysis, amoxicillin-clavulanate and cefpodoxime-proxetil were deemed equally cost-effective (Landholt and Kotschwar, 1994).
The specific results of the studies differ as well. For example, Oh, Maerov, Pritchard, et al. (1996) found that cefaclor monotherapy and amoxicillin-clavulanate produced nearly identical quantities of health benefits per patient measured as quality-adjusted patient-days, but that direct treatment costs with cefaclor monotherapy were 10 percent lower per patient than the direct costs of amoxicillin-clavulanate. Conversely, Weiss and Melman (1988) concluded that cefaclor monotherapy yielded a 5 percent higher treatment cost per patient than amoxicillin monotherapy. And finally, Branthaver, Greiner, and Eichelberger (1997) reported that there seemed to be no differences in the direct costs per patient of five antibiotic therapies, including amoxicillin monotherapy, amoxicillin-clavulanate, and cefaclor monotherapy, but that cefaclor monotherapy and trimethoprim-sulfamethoxazole produced a higher cure rate than the other antibiotics. These conflicting findings make it unclear whether the treatment cost of cefaclor monotherapy is higher than, lower than, or the same as the treatment cost of amoxicillin and other antibiotics.
The evaluative economic literature on antibiotic treatments for AOM is too small, its methodologies too varied, and its findings too inconsistent to provide a clear-cut guide for choosing the most cost-effective antibiotic therapy. One possible reason for the inconsistencies in results is that the total treatment costs of antibiotics like amoxicillin and cefaclor may not be greatly different. Two of the four studies discussed here did claim that there appeared to be nonsignificant differences in the total treatment costs of alternative antibiotics (Oh, Maerov, Pritchard, et al., 1996; Weiss and Melman, 1988). Even the two studies that favored one antibiotic over another did not report large differences in efficacy and treatment costs, and it is conceivable that true efficacy rates and direct treatment costs do not differ materially among several of the antibiotic alternatives (Oh, Maerov, Pritchard, et al., 1996; Weiss and Melman, 1988). The issue should be explicitly addressed in future research.
Other research problems and issues also should be addressed in new cost-effectiveness analyses of antibiotic therapies for AOM. Some of these are the following:
Large, national representative databases should be used for determining medical care utilization and prices. The studies discussed here all employed small local databases, and their estimates of illness and treatment costs might be unrepresentative of costs in the United States as a whole.
A societal perspective should be adopted, and indirect illness and treatment costs should be incorporated in evaluative studies. The national cost estimate of AOM illness suggests that indirect costs constitute nearly half of the total treatment costs of AOM. A national cost burden that large should not be ignored, and the inclusion of indirect costs may have substantial effects on the results of cost-effectiveness analyses. For example, Landholt and Kotschwar (1994) noted that amoxicillin-clavulanate caused an average of 32 hours of lost parental work time per patient in their sample (chiefly due to adverse side-effects), and that cefpodoxime-proxetil caused an average of only 16 hours of lost work time per patient. Had this time been priced and included in their analysis, it would have altered their conclusion that amoxicillin-clavulanate and cefpodoxime-proxetil are equally cost-effective. Finally, if direct treatment costs are approximately the same for all antibiotic therapies, payers have no disincentives to sanction or provide therapies with low indirect costs. Hence, the selection of low indirect-cost antibiotic treatments for AOM would benefit patients' parents without penalizing payers.
A standard generic measure of the health benefits of treatment, such as quality-adjusted or healthy life-years (or days), should be adopted and used in cost-effectiveness analyses. There are three reasons for this. First, a standard generic measure of treatment benefits would provide for comparability of study results. Second, the conventional two-treatment cutoff-point methodology in cost-effectiveness analysis requires the definition of a cutoff point, typically the maximum amount that society pays for a quality-adjusted or healthy year of life. As a practical matter, it is not feasible to define a meaningful cutoff point when the measure of treatment benefits for AOM is the rate of cures, a symptom severity score, or any sort of illness-specific health outcome. Third, an illness-specific or other idiosyncratic measure of treatment benefits makes it impossible for decisionmakers to allocate spending among treatments for AOM and other illnesses in a rational manner. The decisionmaker must have estimates of how its population's overall health benefits are affected when it provides or sanctions treatments for many illnesses. Unless health benefits are (or can be) defined identically for all illnesses, there are no ways to determine how a shift in spending -- for example, to more expensive or less expensive treatments for AOM -- affects the population's aggregate level of health and well-being. Quality of life in AOM recently has become a research issue (Alsarraf, Jung, Perkins, et al., 1998; Rosenfeld, Goldsmith, Tetlus et al., 1997;), but only one of the four studies attempted to estimate and incorporate patients' quality-adjusted survival time into its cost-effectiveness analysis (Oh, Maerov, Pritchard, et al., 1996).
The costs and health benefits of treatment failures and complications should be recognized and incorporated into evaluations of treatments for AOM. The economic impact of hearing loss on children's learning abilities and subsequent lifetime earnings capabilities should be rigorously evaluated. Unless the probability or risk of progression of AOM to more serious illness is deemed independent of the mode of treatment, the effects of disease progression on costs and patients' health outcomes should be accounted for in cost-effectiveness analyses. According to the cost-of-illness estimates obtained here, the cost per case of OME is up to 10 times as large as the treatment cost of AOM. Even small differences in treatment failure rates may therefore have large effects on the relative cost-effectiveness of different antibiotics for AOM. Although two of the studies discussed here found that cefaclor was a cost-effective antibiotic for AOM (Branthaver, Greiner, and Eichelberger, 1997; Oh, Maerov, Pritchard, et al., 1996), it has been reported that cefaclor was associated with an especially high recurrence rate of illness (Kaplan, Wandstrat, and Cunningham, 1997). If that is the case, the high cost and adverse health consequences of recurrent illness argue prima facie against the cost-effectiveness of cefaclor therapy.
A review of the economic literature identified four estimates of the annual cost of OM in the United States. Each is a prevalence estimate derived as the product of an estimated cost per patient and an estimated annual prevalence of the illness.
Gates (1996b) placed the annual national total cost of AOM at $3.15 billion in the 0-4 year age group at an unspecified date in the early or mid- 1990s. The estimated cost per episode of illness was $233.50 ($100 in direct medical costs, $25 in travel expenses, and $107.50 in lost parental wages due to caregiving), and the total annual number of episodes of illness was assumed to be 14 million.2 However, Gates also assumed an average of 2.5 physician visits per episode of illness, so that the total national number of physician visits would have been 35 million for the 0-4 year age group alone. There are no national data that are consistent with so large a number. Data from the 1995 NAMCS indicate a national total of 24.781 million ambulatory care visits for "otitis media and eustachian tube disorders" in all age groups (Schappert, 1997), and the number of visits received by children in the 0-4 year age group for AOM would have been somewhat smaller still. This suggests that Gates' estimate of the national cost burden of AOM is exaggerated by more than 50 percent.
The most often-cited estimate of the national cost of OM is by Stool and Field (1989). Stool and Field put the cost at $2.4-3.3 billion in the 0-6 year age group in an unspecified year -- apparently in the middle or late 1980s. Like the Gates study, Stool and Field may have intended their estimate as an approximation of the true figure rather than as a precise calculation. The direct medical cost per episode was assumed to be $91, the average cost of surgery was placed at $37-$75, and lost parental wages were set at $18-$36. The total annual number of episodes of illness was unreferenced but assumed to be 16.8 million. Like Gates' assumed prevalence, the figure of 16.8 million episodes seems excessively high, and it almost certainly biases the Stool and Field estimate of the national cost of OM upward. Otherwise, the large difference in the cost per episode between the Stool and Field and Gates estimates -- $100 or more -- is due to Gates' inclusion of parental travel costs in the calculation and his imputation of a much larger value of lost parental wages.
In the third study, Berman et al. (1994) used the decision-tree method to estimate the total cost per case (including parental travel expenses and lost wages) of persistent middle ear effusion (PMEE) for a hypothetical 13-month-old boy. Priced at Colorado Medicaid reimbursement levels in 1992, the cost per case was $720-$1,372, varying with the assumed treatment regimen. Priced at private practice reimbursement levels in Denver in the same year, the cost was $1,265-$2,588, also varying with the assumed treatment regimen. Although Berman et al. did not give a national cost estimate, they conjectured an annual national total of 1.9 million cases of PMEE in the group younger than age 2 on the assumption of 9.3 million cases of AOM in the age group, 20 percent of which result in PMEE. At 1.9 million cases per year, the annual medical cost of PMEE in the 0-1 year age group would have been $1.37-$4.92 billion, depending on the treatment regimen and whether utilization was priced at Colorado Medicaid payment levels or private practice payment levels in the Denver area.
The only estimate of the national cost of OM using a data-based estimate of costs per case was prepared for the guidelines on treating OME by Stool et al. (1994). Claims data from more than 100 health insurers were used to estimate the direct costs of OME in the 2-year-old age group in 1991. Including estimates of lost parental wages, the total cost of OME was put at $406 per child for medical treatment only, $2,174 for a child undergoing myringotomy with tube insertion, and $3,433 per child undergoing adenoidectomy. The estimated overall average cost per child was $1,330. The annual national prevalence of OME in the 2-year-old age group was set at 821,700 episodes, so that the national total cost of OME was estimated at $1.09 billion in 1991.
The four studies imply that the annual national cost of OM runs into several billions of dollars, but in other respects their results cannot be easily summarized. Only one of the four expressly estimated the national cost of AOM. The Gates and Stool and Field estimates assume prevalences of illness that seem to be at odds with the only available national data on the utilization of ambulatory care visits for OM. The estimates from the Berman et al. and Stool et al. studies are restricted to episodes of illness in very young children. All of the studies omitted the indirect cost of unpaid family caregiving services provided by unemployed parents and by employed parents during nonworking hours.
On balance, the national cost estimates are overstated insofar as they embody inflated estimates of the prevalence of OM. They also are understated to the extent that they are restricted to very young age groups of children, do not include all forms of OM, and exclude the indirect costs of unpaid family caregiving services.
The societal cost of an illness is conventionally defined as the total value (priced as an aggregate opportunity cost) of all goods and services consumed, destroyed, or foregone as a result of the illness and its treatment. In addition, the societal cost of a treatment encompasses not only the value of resources consumed by the treatment itself, but also the value of resources consumed, destroyed, or foregone due to treatment complications and failures. For this report, OME and chronic middle ear infections were considered the consequences of unsuccessful treatments of AOM. In cost-of-illness studies and cost-effectiveness analyses, it is customary to regard the costs of treatment failures and sequelae as costs of the initial illness and its treatment. Thus, the cost of AOM was defined as the societal cost of all forms of OM and not just of AOM alone.
The national cost of OM was estimated with the same two-step method employed in the four studies described above. That is, estimates of the cost per episode of OM were multiplied by estimates of the total number of episodes of illness. We assumed that we could estimate the total annual number of episodes of OM as the product of age-specific (and possibly sex-specific) episode rates of OM and the sizes of the relevant-age cohorts of children in the United States. We reviewed the epidemiological literature for age-specific annual episode rates of illness.
Two limitations were imposed on the review: it was restricted to findings on U.S. samples of children, and it was narrowed to studies performed after 1990. The reasoning was as follows.
First, a substantial body of epidemiological research on OM has been performed outside the United States, particularly in Northern Europe. Nevertheless, it is well known that the incidence and prevalence rates of OM vary with race, climate, urban and rural location, frequency of contact with other children (such as in day care centers), and other factors. Because it is unclear that these influences are the same in the United States and other countries, estimates of the incidence and prevalence rates of OM obtained outside the United States and Canada may not be applicable to this country. Therefore, non-U.S., non-Canadian studies were consequently omitted from the review.
Second, there is significant evidence that the prevalence rate of OM in this country increased dramatically from the mid- 1970s to 1990. The indications are mixed as to whether the upward trend in the prevalence rate has leveled off in the 1990s. In any event, it seemed likely that episode rates of OM derived before 1990 would give downward-biased estimates of the episode rates prevailing in the mid- or late 1990s. This is not to say that all such studies are biased. If a pre- 1990s study focused on a sample of children with predispositions to OM, its episode rates might have considerably overrepresented national rates at the time it was performed but give accurate estimates of rates in the mid- and late 1990s. Nevertheless, although epidemiological studies conducted as early as the late 1970s were reviewed, they were set aside on grounds that they were not clearly applicable to recent experience in the United States.
Only one relevant epidemiological study of OM has been performed in the U.S. since the mid- 1980s (Yawn and Lydick, 1996). The study, conducted in Rochester, MN in 1994-95, reported the numbers of episodes of illness per child within 1-year age cohorts for children aged 12 and younger. However, when these episode rates were multiplied by the sizes of 1-year age cohorts in the 0-12-year U.S. population in 1995 (Day, 1996), they produced a total of 36.3 million episodes of OM, and it is not possible to reconcile this estimate with the NAMCS estimate of 24.781 million ambulatory care visits for "otitis media and eustachian tube disorders" in the same year (Schappert, 1997). The Yawn et al. estimates were obtained by telephone interviews with parents. Thus, many responses may have been inaccurate or, if they were accurate, many of the reported episodes of infection may not have received medical care.3 For this report it was taken as a working hypothesis that the NAMCS estimate is correct and thus that the Yawn et al. episode rates greatly exaggerate the national number of treated cases of OM. We therefore concluded that all published estimates of the rates of episodes of OM per child significantly bias estimates of the national number of treated episodes of OM in the mid- 1990s.
Because the epidemiological literature appeared not to yield demonstrably reliable rates for episodes of illness (and none at all in the 13- to 17-year-old age group), the total national number of episodes of AOM in 1995 was estimated from NAMCS and other national data and from individual studies in which the number of physician visits per episode of illness was reported.
The dearth of data and information sources made it necessary to use a number of assumptions and simplifications to derive both the national number of episodes of OM and the cost per episode. In summary, the principal features and premises of the estimation procedure were these:
National illness costs were derived for the year 1995. Certain data used in deriving and validating the estimates were not yet available for 1996 and later years when the report was begun.
The estimated national cost of OM refers to children younger than 18 years of age.
The estimates of total national medical care utilization for OM were constructed to be as closely consistent as possible with the available (NAMCS and other) reports of national utilization for ear infections.
Episodes of OME/chronic middle ear infection that result from unsuccessful treatments of AOM were considered complications of AOM, and their cost was consequently considered a cost of AOM.
It was assumed that the 1995 (NAMCS) national total of 24.781 million ambulatory visits for OM and eustachian tube disorders were for OM and its complications. No age distribution of the visits has been published. Thus, to estimate the number of visits by patients aged 17 and younger, it was assumed that the age distribution of visits was identical to the national age distribution of acute ear infections as reported by the National Health Interview Survey (NHIS) in 1995. According to the 1995 NHIS, there were 23.568 million acute ear infections in the United States, 82. 195 percent of which occurred in the 17-year old and younger age group (Benson and Marano, 1998). Hence, it was assumed that 20.38 million (24.781 million x 0.82 196) ambulatory care visits were provided nationally in 1995 to children under 18 with OM.
It was next assumed that the total number of ambulatory care visits for OM is the sum of the numbers of visits for AOM and OME/chronic middle ear infections. To estimate the numbers of episodes of AOM and OME/chronic middle ear infection from the total number of ambulatory care visits for OM, the following method was employed. Let
A=
total annual number of episodes of AOM
O=
total annual number of episodes of OME/chronic middle ear infection
k=
fraction of all episodes of OM that are episodes of OME/chronic middle ear infection
T=
total number of ambulatory care visits for OM
Va=
average number of ambulatory care visits/episode for AOM
Vo=
average number of ambulatory care visits/episode for OME/chronic middle ear infection. Then
A·Va + O·Vo=T
O=k·(A+O).
Assuming that the values of all variables other than A and O are known or estimable, the solution of the equation system is
(1) A=(1-k)T/[(1-k)Va + kVo]
(2) O=kA/(1-k).
These two relations were used to estimate the numbers of episodes of AOM and OME/chronic middle ear infusion.
| Cost Component | Cost ($) | Assumptions | Source |
|---|---|---|---|
| Direct Costs | 114.69 | ||
| Physician Visits | 75.69 | 1.75 visits/episode 2/3 of visits to pediatricians, 1/3 to family/general practitioners Mean charge/visit=$48.07 Physicians paid 90% of charges | Branthaver et al (1997); Gates (1996b); Kaplan et al (1997); Landholt and Kotschwar (1994); Stool and Field (1989)Oh et al (1996); Weiss and Melman (1988); Nelson and Woodwell (1998); Gonzalez (1995) |
| Drugs | 19.62 | 1 course of antibiotics Mean costs in 2 Medicaid plans | White et al (1996); Berman et al (1997) |
| Laboratory | 5.63 | -- | Kaplan et al (1997) |
| Travel | 8.75 | $5/physician visit | Berman et al (1994); Gates (1996); Kaplan et al (1997); author |
| Paid in-home care, supplies | 5.00 | -- | Landholt and Kotschwar (1994); Kaplan et al (1997); Yawn et al (1996) |
| Indirect Costs | 99.50 | ||
| Lost parental wages | 54.50 | 4 hours @ $11.35/hour plus 20% fringe benefits | Gates (1996); Kaplan et al (1997); Landholt and Kotschwar (1994); Stool and Field (1989); Weiss and Melman (1988); Yawn et al (1996) |
| Unpaid caregiving services, excluding lost work time | 45.00 | 6 hours @ $7.50/hour | Author |
| Total Cost | 214.19 |
The base-case values of T, Va, Vo, and k applied to the equations (1) and (2) yielded an estimated 5.18 million annual episodes of AOM and 2.22 million episodes of OME/chronic middle ear infection. Following Berman et al. (1994), it was next assumed that 20 percent of all treated episodes of AOM progress to OME/chronic middle ear infection. Under that assumption, 1.04 million episodes of OME/chronic middle ear infection (approximately 47 percent of the total number of episodes) were complications of or the results of failed treatments for AOM. The cost of 1.04 million episodes of OME/chronic middle ear infection was therefore attributed to AOM.
The cost per treated episode of AOM has been estimated in seven studies published since the late 1980s (Branthaver et al., 1997; Gates, 1996b; Kaplan et al., 1997; Landholt and Kotschwar, 1994; Oh et al., 1996; Stool and Field, 1989; Weiss and Melman, 1988). The costs range from $39 to $233.50, varying with the date and geographic location of the estimate and with the items of direct and indirect cost included by authors. After inflating them to mid- 1990s price levels, the majority of the estimates cluster at roughly $125-$130 per episode. Even so, they differ sufficiently in composition and assumptions (such as the number of physician visits per episode) to make them dubiously representative of the average national cost per episode of AOM.
To estimate the direct cost per treated episode of AOM, it was assumed as above that patients received an average of 1.75 physician office or clinic visits. In 1995, private family and general practitioners charged an average of $45.87 for an office visit with an established patient, and pediatricians in private practice charged $49.17 (Gonzalez, 1996). It was then assumed that:
two-thirds of the children with AOM visited pediatricians and one-third visited family/general practitioners (Nelson and Woodwell, 1998);
(private) physicians were paid 90 percent of their billed charges; and
payments per visit -- $41.28 and $44.25 respectively -- are reasonable estimates of the societal costs per visit for treating AOM.
The assumptions yield a mean cost per visit of $43.25 and a cost of $75.69 per episode of AOM for physician services.
The standard premise in all seven studies of AOM treatment costs is that (successfully) treated patients receive one or two courses (or prescriptions) of antibiotics, most commonly amoxicillin or cefaclor. It was assumed conservatively that patients received an average of only one course of treatment. The mean cost of one course of first-line antibiotics for AOM was said to be $16. 19 in the Tennessee Medicaid plan in 1993 (White, Holiman, Tepedino, et al., 1996) and $20.27 in the Colorado Medicaid plan in 1991-92 (Berman, Byrns, Bondy, et al., 1997). Other reports or estimates of drug costs are taken from much smaller samples of data and vary widely with the specific drugs prescribed by physicians. The Tennessee and Colorado Medicaid plan costs were therefore inflated to 1995 levels by the drug component of the Consumers Price Index (U.S. Bureau of the Census, 1998) and averaged. The resulting cost, $ 19.62, was taken as a reasonable estimate of the societal cost of antibiotics for an episode of AOM.
Only one estimate of laboratory costs per episode, $5.63 in a Charleston, WV, practice in 1994 (Kaplan et al., 1997), has been reported in the recent literature. It was used as an approximation of the costs of laboratory services. Family travel costs have been estimated by authors or derived from data in three recent studies. The costs were priced at $7.70, $7.59, and $10 per physician visit (Berman et al., 1994; Gates, 1996b; Kaplan et al., 1997). Although it is hard to conjecture an average cost of travel to providers, the direct cost per round trip was placed conservatively at $5 per physician visit or $8.75 per episode. Families also may pay for in-home care for the child and buy supplies such as antidiarrheals, electrolytes, and extra diapers for children experiencing the adverse side effects of antibiotic therapy. There are two reports of these costs -- $0.77 for baby sitters (Kaplan et al., 1997) and $1.79-$6.82 for other supplies (Landholt and Kotschwar, 1994). Yawn et al. (1996) gave the figure of about 30 minutes of unnamed "special child arrangements" per episode of OM. They did not assign a cost to the arrangements, but it seems unlikely that the cost would exceed $3-$4 per episode. The total cost of paid inhome care and nonmedical supplies was therefore set at $5 per episode of AOM.
All published estimates of the indirect cost of AOM limit the scope of the cost to foregone parental wages. The common assumption or observation is that an employed parent leaves work to take the sick child to visit a physician. The estimates of lost work time and lost wages (i.e., the value of labor product forgone by society because of the child's illness) differ markedly, possibly because of interstudy differences in work force participation rates. Yawn et al. (1996), and Weiss and Melman (1988) gave estimates of 0.4-0.5 work days lost per episode of AOM, but Landholt and Kotschwar (1994) put the average family work time loss at only 0.6-1.3 hours per episode. Kaplan et al. (1997) gave an apparently data-based estimate of $34.38 in lost parental wages per episode of illness. Stool and Field (l989) and Gates (1996b) conjectured costs of $18-$36 and $107.50 per episode, respectively.
Unpaid caregiving services for AOM include travel services by parents, communication with physicians, shopping services for prescriptions and other supplies, and all exceptional child care (feeding, attending, administering drugs, doing laundry, etc.) caused by illness. Because there are no conclusive ways of knowing whether the typical or average caregiver of a sick child is employed, the relatively conservative assumption was made that 4 work hours or 0.5 work days per child are lost due to caregiving for an episode of AOM. In 1995 the average hourly earnings of employed workers was $11.35, excluding fringe benefits (U.S. Bureau of the Census, 1996). Consequently, given a fringe benefit rate of 20 percent, the average indirect cost of societal lost work product was $54.50 per episode of AOM.
There are no estimates of the indirect cost of unpaid family caregiving services by unemployed parents or by employed parents during weekends or other nonworking hours. Any imputation of this cost must therefore be speculative. It was assumed conservatively that the family devotes an hour of unpaid caregiving each day over a 10-day course of illness. As above, 4 hours were provided by a parent who left work, and the remaining 6 were provided with no loss of work time. In 1995, the mean hourly wage rate for paid inhome health care services was $10.91 (U.S. Bureau of the Census, 1996). However, because a high level of caregiving skill is probably not necessary for a child with OM, the hourly opportunity cost of unpaid services was set at $7.50, approximately the average of $10.91 and the hourly minimum wage. The estimated opportunity cost of unpaid caregiving services was therefore $45.00 (6 × $7.50) per episode of AOM.
Berman et al. (1994) put the average cost, including all direct costs and the indirect cost of lost parental wages, of an episode of OME/recurrent or persistent middle ear infection at $720-$2,588 for a "hypothetical 13-month-old boy" in the Colorado study in 1992. The wide range occurred because of variations in treatment and differences in the payment mechanism (Medicaid or private fee-for-service).
The only data-based estimate of the cost of OME is by Lewin-VHI and is reported in Stool et al. (1994). It was used here to estimate the cost per episode of OME/chronic ear infection. The estimate was derived from a sample of health insurance claims (from more than 100 different insurers) for 1,898 patients. Mean direct, indirect, and total costs (payments to providers) per episode of illness were placed at $1,060, $270, and $1,330 per episode, respectively, in 1991. Unfortunately, the figures obtained by Lewin-VHI have several shortcomings. First, the cost estimates were made only for 2-year-old children, and the authors remark that costs were "similar [but] not identical" for other age groups. Second, the costs of drugs were not observed but conjectured on the basis of prescription patterns obtained from "practice surveys [and] an unpublished study." Third, indirect costs were defined only as foregone wage and salary income when parents left work to transport children to medical providers. Moreover, the authors assumed rather than observed the durations of missed work time. Any of these features of the cost calculations might give distorted estimates of the true costs per case.
The Lewin-VHI estimate of direct cost per episode of illness was inflated to 1995 price levels by the medical care component of the Consumer's Price Index. The estimate of indirect cost per episode of illness was inflated by the percentage change in average national hourly earnings from 1991 to 1995 (U.S. Bureau of the Census, 1992, 1996). The 1995 estimates of direct, indirect, and total costs per episode of OME were $1,321, $299, and $1,620.
The indirect cost of unpaid family caregiving services provided to children with OME/chronic ear infections by unemployed parents and employed parents during nonworking hours has never been estimated and must also be conjectured. Recent studies place the average duration of an episode of OME at 17-23 days (Casselbrant et al., 1985; Klein et al., 1990; Teele et al., 1990; Paradise et al., 1997). Because all of the estimates refer to children aged 7 or younger and the duration of illness appears to decline with age, the average length of illness for all children aged 17 and younger was conservatively set at 17 days. In the absence of more complete data, it was consequently assumed that families provide an average of 1.5 (nonworking) hours per day of unpaid caregiving services to children with OME/chronic middle ear infection over 17 days of illness. Lewin-VHI (Stool et al., 1994) reported that 55 percent of their sample of 2-year-olds continued treatment for OME for at least 3 months. Hence, the estimate of 25.5 hours of nonworking caregiving time per episode of OME may be conservative. The level of required caregiving skill may be higher than that needed for AOM, but the imputed hourly wage rate for unpaid care was set at $7.50 as before. Thus, the total opportunity cost of unpaid caregiving services was $ 191.25 per episode of illness.
The assumptions given here yield a total cost of $1,811.25 for an episode of OME/chronic middle ear infection in 1995.
The estimated direct and indirect costs per episode of illness were $1,321 and $490.25, respectively.
To summarize, the procedures described here yielded the following estimates for the 0- to 17-year age group:
Total annual number of episodes of AOM: 5.18 million.
Number of episodes of OME/chronic middle ear infection attributable to AOM: 1.04 million.
Direct, indirect, and total costs per episode of AOM: $114.69, $99.50, and $214. 19, respectively.
Direct, indirect, and total costs per episode of OME/chronic middle ear effusion: $1,321.00, $490.25, and $1,811.25, respectively.
In 1995, the estimated total national cost of AOM and its complications was therefore $2.983 billion [(5.18million)·$214. 19 + (1.04 million)·$1,811.25]. The total direct cost was $1.961 billion and the total indirect cost was $1.022 billion.
Direct and indirect costs accounted for approximately 66 percent and 34 percent, respectively, of total illness costs.
| Episodes of OME/Chronic Middle Ear Infection as Percentage of All Episodes of OM | Percentage of Episodes of AOM That Progress to OME/Chronic Ear Infection | |||
|---|---|---|---|---|
| 10 | 20 | 30 | 40 | |
| Annual Number of Ambulatory Care Visits for OM=20.37 Million (Base Case) | ||||
| 10 | 3,476 | 5,068 | 6,661 | 8,254 |
| 25 | 2,334 | 3,403 | 4,473 | 5,542 |
| 30 | 2,046 | 2,983 | 3,921 | 4,858 |
| 35 | 1,791 | 2,612 | 3,432 | 4,253 |
| 50 | 1,176 | 1,714 | 2,253 | 2,791 |
| Annual Number of Ambulatory Care Visits for OM=25 Million | ||||
| 10 | 4,266 | 6,221 | 8,175 | 10,130 |
| 25 | 2,865 | 4,177 | 5,490 | 6,802 |
| 30 | 2,511 | 3,662 | 4,812 | 5,963 |
| 35 | 2.198 | 3,205 | 4.212 | 5,219 |
| 50 | 1,443 | 2,104 | 2,765 | 3,426 |
| Annual Number of Ambulatory Care Visits for OM=30 Million | ||||
| 10 | 5,119 | 7,465 | 9,810 | 12,156 |
| 25 | 3,438 | 5,013 | 6,588 | 8,163 |
| 30 | 3,013 | 4,394 | 5,775 | 7,155 |
| 35 | 2,638 | 3,846 | 5,055 | 6,263 |
| 50 | 1,731 | 2,525 | 3,318 | 4,111 |
| Annual Number of Ambulatory Care Visits for OM=35 Million | ||||
| 10 | 5,972 | 8,709 | 11,445 | 14,182 |
| 25 | 4,010 | 5,848 | 7,865 | 9,523 |
| 30 | 3,515 | 5,126 | 6,737 | 8,348 |
| 35 | 3,077 | 4,487 | 5,897 | 7,307 |
| 50 | 2,020 | 2,945 | 3,871 | 4,796 |
| Annual Number of Ambulatory Care Visits for OM=50 Million | ||||
| 10 | 8,532 | 12,441 | 16,350 | 20,259 |
| 25 | 5,729 | 8,354 | 10,979 | 13,604 |
| 30 | 5,022 | 7,323 | 9,624 | 11,925 |
| 35 | 4,396 | 6,410 | 8,425 | 10,439 |
| 50 | 2,885 | 4,208 | 5,530 | 6,852 |
Circled figure is the total cost derived from base-case assumptions.
For example, although the NAMCS data on ambulatory care visit totals seem more accurate than the visit totals implied by epidemiological studies of OM, it has been suggested that the national numbers of ambulatory care visits compiled by NAMCS significantly understate the true totals (Glass et al., 1991). Although there exists no hard evidence that supports the claim, it remains a possibility that the 20.37 million visits figure used to estimate costs is biased downward.
In addition, Teele et al. (1980) reported that 40 percent of treated AOM patients exhibit symptoms of illness for at least 1 month and that 20 percent exhibit symptoms for at least 2 months. This could mean that the true percentage of the episodes of AOM that progress to OME/chronic middle ear infection is somewhat higher than the base-case percentage (20) used in the analysis here.
A review of the epidemiological literature on OM was conducted to determine whether it provided reliable estimates of the annual rate of episodes of illness per child. The review was limited to studies performed in the United States and Canada during or after the late 1970s. As stated in the preceding section, studies performed elsewhere were deemed of doubtful relevance to the occurrence of OM in the United States. Studies published before 1980 also were excluded because of the apparently large increase in OM attack rates after 1975. For example, data from the NAMCS show that, depending on age and sex, the annual number of office visits per child for OM increased by 125-250 percent from 1975 to 1990 in the 0- to 5-year old age group (Schappert, 1992). Similarly, data from the National Health Interview Surveys (NHIS) indicate that the annual prevalence rate of acute ear infections in the 0- to 4-year old age group increased by 28-84 percent from 1982 -- the first year that these infections were reported -- to 1990, also depending on sex (National Center for Health Statistics, 1985; Adams and Benson, 1991). An epidemiological study performed in the early 1980s in Montreal also described an 11-26 percent increase over a 3-year period in the number of episodes per child of OM among 3- and 7-year-olds (Croteau et al., 1990). This evidence strongly implies that the prevalence and incidence rates of OM estimated before 1980 are likely to give downward-biased estimates of the current prevalence and incidence rates of OM.
It is not altogether clear that upward trends in the incidence and prevalence rates of OM have stabilized since 1990. At present, the only longitudinal data pertinent to the issue are NAMCS and NHIS data, and these have been published only up to the mid- 1990s. According to NAMCS and NHAMCS estimates, the total national number of ambulatory care visits for suppurative and unspecified OM (all ages) peaked at 20.033 million in 1989, fell to 16.185 million in 1991, and rose to 19.309 million in 1993 (Nelson and Woodwell, 1998). NHIS data also show large annual variations in the national prevalence rate of acute ear infections in the 0-17-year-old age group from 1990 to 1995, but reasonably evident trends in the rate appear only for children age 5-17 -- a 14 percent increase for girls and a 32 percent increase for boys (Adams and Benson, 1991; Benson and Marano, 1998). Although these data summaries give a mixed picture, they suggest that the occurrence of OM in the 0-17 year age group may still be increasing. If that is true, incidence and prevalence rates derived as recently as the early 1990s may also understate the true current rates.
| Study | Biles et al (1980)1 | Marchant et al. (1984)2 | Casselbrant et al. (1985) 3, 4 | Teele et al. (1989)4 | Croteau et al. (1990)5 | Yawn et al. (1996)5 |
| Definition of illness | Otitis media | Otitis media | Otitis media with effusion | Acute otitis media | Otitis media | Otitis media |
| Date of study | 1975 | Not specified | 1981-83 | 1975-84 | 1981-83 | 1994-95 |
| Location | Galveston, TX | Cleveland, OH | Pittsburgh, PA | Boston, MA | Montreal, QU | Rochester, MN |
| Sample size | 1,018 | 70 | 140 | 498 | Very large, not specified | 9,047 |
| Age group (years) | 0-8 | < 1 | 2-6 | 0-6 | 3, 7 | 0-12 |
| Estimated Number of Episodes, 1995 (millions)6 | ||||||
| Age Group (Years) | ||||||
| < 1 | 8.1 (36.5% aymptomatic) | 4.6 | 3.8 | |||
| 3 | 3.2 | 2.7 | 4.3 | |||
| 0-6 | 21.1 | 30.4 | ||||
| 2-6 | 36.9 | 12.3 | 18.1 | |||
| 7 | 1.4 | 1.6 | ||||
| 0-8 | 15.0 | 33.2 | ||||
| 0-12 | 36.3 | |||||
Data collected retrospectively from medical records. Authors say estimates may understate true prevalence.
Some cases of illness diagnosed during monthly well-child visits.
All children in sample attended day care center.
Dropouts from initial sample had lower rates of illness than patients remaining in study to conclusion. Authors say that dropout behavior may have caused the observed prevalences of illness to overstate those of t he overall population.
Data collected by RNs from telephone interviews with parents.
Mean episodes per child reported by authors times estimated U.S. population in age cohort (Day, 1996).
On that basis it was concluded from the review that the existing epidemiological literature does not provide reliable estimates of the annual numbers of treated episodes of OM in the U.S. during recent years.
The patient presents, either in the office or by phone, with ear pain or some other symptom suggesting otitis media, type unspecified. At this point, the practitioner does not know with absolute certainty if the patient has:
a diagnosis other than otitis media
otitis media with effusion
acute otitis media
otitis media without effusion (i.e., myringitis)
otitis media with another diagnosis
The practitioner must have in mind definitions for diagnosing:
a diagnosis other than otitis media
otitis media with effusion
acute otitis media
otitis media without effusion (i.e., myringitis)
otitis media with another diagnosis
The
definitions may be correct or incorrect.
The practitioner must gather appropriate information:
history
physical examination (e.g., pneumootoscopy)
diagnostic tests (e.g., tympanogram, tympanocentesis,
acoustic reflectometry, audiogram)
The
practitioner may gather the correct or incorrect
information.
The practitioner must use the information gathered to make a diagnosis of:
a diagnosis other than otitis media
otitis media with effusion
acute otitis media
otitis media without effusion (i.e., myringitis)
otitis media with another diagnosis
The
diagnosis may be correct or incorrect
Once a diagnosis of acute otitis media is made, the practitioner must choose a therapeutic option:
observation and no intervention
antibiotics
which antibiotic
dose of antibiotic
schedule of antibiotics
length of treatment
steroids
analgesics
antihistamines/decongestants
tympanostomy
any combination of 5.b.-5.f.
The therapeutic
option chosen may be correct or incorrect.1
After implementing a therapeutic option, the practitioner must prescribe a followup strategy:
followup
length of time after initiation or end of treatment
number of followups
intervals between followups if more than one
no followup
The practitioner must have in mind
criteria for the need for recheck and followup that may
be correct or incorrect; the followup strategy chosen
may itself be correct or incorrect.1,2
At followup, the practitioner must have in mind definitions for:
successful treatment of acute otitis media
unsuccessful treatment of acute otitis media
persistent
recurrent
complications such as mastoiditis
At followup, the practitioner must gather appropriate information:
history (e.g., prior infection)
physical examination (e.g., pneumootoscopy)
diagnostic tests (e.g., tympanogram, acoustic
reflectometry, tympanocentesis, audiogram)
The
practitioner may gather the correct or incorrect
information.
At followup, the practitioner must use the information gathered to make a diagnosis of:
successful treatment
unsuccessful treatment
persistent
recurrent
complications such as mastoiditis
At followup, the practitioner must then decide if further treatment is needed.
If diagnosed as successful treatment, various treatment options may be considered:
observation and no intervention
prophylactic antibiotics
which antibiotic
dose of antibiotic
schedule of antibiotics
length of treatment
refer to Otolaryngology for consideration of:
pressure equalizing tubes
adenoidectomy
tonsillectomy
refer to Hearing and Speech
hearing evaluation
speech evaluation and/or treatment
any combination of 10.a.2)-10.a.4)
If diagnosed as unsuccessful treatment, various treatment options may be considered:
observation and no intervention
antibiotics
which antibiotic
dose of antibiotic
schedule of antibiotics
length of treatment
steroids
analgesics
antihistamines/decongestants
tympanostomy
refer to Otolaryngology for consideration of:
pressure equalizing tubes
adenoidectomy
tonsillectomy
mastoidectomy
refer to Hearing and Speech
| c) | hearing evaluation |
| d) | speech evaluation and/or treatment |
treatment of complications, such as mastoiditis
any combination of 10.b.2)-10.b.9)
After follow-up and implementation of a therapeutic option, the practitioner must prescribe a followup strategy:
follow-up
length of time after initiation or end of treatment
number of followups
intervals between followups if more than one
go to 73
no followup
The practitioner must have in mind
criteria for the need for recheck and followup that may
be correct or incorrect; the followup strategy chosen
may itself be correct or incorrect.1
During an episode of uncomplicated acute otitis media (AOM) that is initially managed WITHOUT antibiotics, what proportion of children have the following outcomes:
presence/absence of pain/otorrhea/irritability/fever/hearing loss at 24 hours, 2-3 days, and 4-7 days?
presence/absence of ALL clinical signs/symptoms, except middle ear effusion (MEE), at 7-14 days?
presence/absence of asymptomatic MEE at 2 weeks, 1 month, and at 3 months?
presence/absence of acute suppurative complications/secondary complications?
To what degree are the above outcomes attributable to:
clinical characteristics including hearing and/or speech delay?
age of the child?
provider degree of diagnostic uncertainty for true AOM?
parent reliability (low vs. high) to report symptom resolution or progression at 48-72 hours if antibiotics are initially withheld?
parent preference concerning antibiotic therapy?
parent education?
analgesic use?
Are antibiotics effective (in terms of statistical significance and magnitude of absolute clinical benefit above and beyond placebo/observational/no treatment/natural history) in the initial treatment of uncomplicated AOM with respect to the following outcome indicators:
presence/absence of pain/otorrhea/irritability/fever/hearing loss at 24 hours, 2-3 days, and 4-7 days?
presence/absence of ALL clinical signs/symptoms, except MEE, at 7-14 days?
presence/absence of asymptomatic MEE at 2 weeks, 1 month, and at 3 months?
presence/absence of acute suppurative complications/secondary complications?
When antibiotics are used in the initial treatment of
uncomplicated AOM, which of the following
characteristics are associated with better outcomes compared
to placebo/observational/no
treatment/natural
history?
clinical characteristics including hearing and/or speech delay?
age of the child?
provider degree of diagnostic uncertainty for true AOM?
parent reliability (low vs. high) to report symptom resolution or progression at 48-72 hours if antibiotics are initially withheld?
parent preference concerning antibiotic therapy?
parent education?
analgesic use?
Does the specific antibiotic regimen make a difference?
(Antibiotic class) Are antibiotics with broader coverage than
amoxicillin or trimethoprim sulfa more cost-effective or cost-beneficial
in the initial treatment of uncomplicated AOM?
(Antibiotic class) What is the utility of oral fluoroquinolones in the initial treatment of uncomplicated AOM in childhood? What are the side effects?
(Dose of antibiotic) What is the value of using 60-80 mg/kg/dof amoxicillin or amoxicillin-clavulanate vs. the standard 40 mg/kg/d?
(Schedule of antibiotic) Is twice a day high dose amoxicillin therapy as effective as three time a day amoxicillin therapy in the initial treatment of uncomplicated AOM?
(Length of treatment) What is the comparative efficacy of short- vs. long-term antibiotic
therapy in children younger than 2 years of age and those older than 2 years of age? Is the use of a single injection of ceftriaxone or the use of other cephalosporin for treatment of AOM more or less likely than 7-10 days of oral amoxicillin to predispose to creation of a penicillin/cephalosporin resistant pneumococcal nasopharyngeal flora? Does the risk benefit justify the use of a single injection of ceftriaxone? (Need discussion)
Several of the technical experts felt that Question 1 should be split into outcome and influencing factor questions like Question 3.
One issue brought up during the second conference call related to the difference between "natural history of acute otitis media when nothing is done including not seeking care from the health care provider" and "observational treatment prescribed by the health care provider." We decided that the issue brought up an important point and Question 1 was retitled to address the latter.
Another issue brought up was on the real objective of Question 3b. Are we addressing the amount of influence of the listed factors on the "selective initial use of antibiotics" or on the "effectiveness of the initial use of antibiotics." The former is an analysis of the prescribing pattern which is a process variable and the latter is an analysis of the effectiveness of initial use of antibiotics which is an outcome variable. Our project team decided to address the influence of the factors on the effectiveness of initial use of antibiotics and leave it up to users of our evidence report to develop guidelines for appropriate prescribing patterns. Question 3b) was thus reworded accordingly.
On the issue of defining uncomplicated AOM, there were several suggestions, ranging from "inflammation of the middle ear cleft" to "one sign and one symptom" to "definitions used by the different studies." The project team decided that a definition must be established before the study could go on because it would affect the search strategy. A poll will be taken among the experts as to the best definition to use for this evidence report. For the evidence analysis, several of the technical experts felt that we may have to accept whatever definition of AOM is found in any given study as they will be quite disparate; however, the project staff feel it is important to establish a standard definition for comparison.
Another issue brought up was on some subquestions in Question 4 that addressed more toward complicated AOM rather than uncomplicated AOM. The two specific ones are 4b) Would antibiotic selection based on local or regional bacterial resistance pattern improve the outcome of antibiotic treatment of AOM? and 4h) How long after an antibiotic is used is it reasonable for it to be used again to treat AOM in terms of reducing the likelihood of developing resistance to antibiotics? These two subquestions were thus excluded from the scope of this evidence report.
An issue on defining endpoints for the study was brought up. The group decided to leave them open to definitions used by different studies. However, the project staff decided that it is important to define the most appropriate endpoints before the literature search and then compare what the literature used with our definitions.
Another issue was on the age of the child to be included in the evidence report. It was suggested by some of the technical experts to exclude the neonate as defined by an age of younger than 8 weeks. Epidemiologically, a neonate is referred to as a newborn 28 days old or younger. For this evidence report we will include studies on children between 28 days and 18 years old.
Several factors were added as influencing factors: gender, ethnicity, presence of ear infection in sibling, craniofacial problems, and cost. In addition, the project staff, based on information in Attachment 4.b-1, added race, sibling(s) in day care, pacifier use, presence of sibling(s), and atopy or allergy. They are included in the scope of the evidence report.
During an episode of uncomplicated acute otitis media (AOM) that is initially managed WITHOUT any intervention, what proportion of children have the outcomes delineated in the scope of the evidence report?
To what degree are the above outcomes attributable to the influencing factors delineated in the scope of the evidence report?
Are antibiotics effective (in terms of statistical significance and magnitude of absolute clinical benefit above and beyond placebo/observational/no treatment/natural history) in the initial treatment of uncomplicated AOM with respect to the outcomes delineated in the Scope of the Evidence Report?
When antibiotics are used in the initial treatment of uncomplicated AOM, which of the influencing factors delineated in the scope of the evidence report are associated with better outcomes compared to placebo/observational/no treatment/natural history?
Does the specific antibiotic regimen make a difference?
(Antibiotic class) Is treatment with antibiotics of broader coverage than amoxicillin or trimethoprim sulfa more effective or result in less total cost in the initial treatment of uncomplicated AOM?
(Antibiotic class) What is the utility of oral fluoroquinolones in the initial treatment of uncomplicated AOM in childhood? What are the side effects?
(Dose of antibiotic) What is the value of using 60-80 mg/kg/d of amoxicillin or amoxicillin-clavulanate vs. the standard 40 mg/kg/d?
(Schedule of antibiotic) Is twice a day high-dose amoxicillin therapy as effective as three time a day amoxicillin therapy in the initial treatment of AOM?
(Length of treatment) What is the comparative effectiveness of short- vs. long-term antibiotic therapy in children younger than 2 years of age and those older than 2 years of age?
The original intent of Question 1, which was to study the natural history of AOM, implies that the clinical course is to be observed "WITHOUT any intervention" and not "WITHOUT antibiotics," which does not exclude the possibility of other interventions.
In Question 1, none of the children will be taking antibiotics; so, parent preference concerning antibiotic therapy should not have any influence on the outcomes. One of the technical experts also felt this factor should be removed from Question 1. One would expect that parent preference concerning antibiotic therapy might be important when antibiotics are being administered and parental compliance with therapeutic recommendations is necessary to complete the treatment as in Question 3.
The term "initial treatment" was not changed; however, the project staff feel that the technical experts must state whether or not "initial treatment" refers to the first course of treatment for an independent episode of uncomplicated AOM. If so, the technical experts must then define what is meant by an independent episode: is it an episode of uncomplicated AOM that is preceded by at least a 3-week period without AOM?
The project staff added side effects and adverse events attributable to antibiotics to the outcomes in Question 3.
For clarity, we refer to the outcomes and influencing factors listed in the scope of the evidence report as being our a priori subquestions of interest. In addition, our economic experts have pointed out that longer-term outcomes, for example greater than 3 months, need to be added, and these have already been added to the scope of the evidence analysis.
It was felt by many of the technical and internal experts and project staff that we should study effectiveness and cost in this study and not cost-effectiveness or cost-benefit because of the lack of time in the 1-year timeframe of this contract to conduct such a detailed microeconomic analysis. Thus, all references to cost-effectiveness and cost-benefit have been changed to references to effectiveness and cost.
Although one of our technical experts pointed out that oral fluoroquinolones have not been approved by the Food and Drug Administration for use in the general populace, we have retained this question because research studies of this antibiotic may be available in the literature.
Any references to efficacy were changed to effectiveness because this study is interested in the impact on outcomes in the clinical setting.
Subquestion 4.f) was absorbed into subquestion 4.a). Subquestion 4.a) will address "antibiotics with broader coverage than amoxicillin or trimethoprim sulfa" which would include single-injection ceftriaxone and other cephalosporins. Subquestion 4.a) will look at bacterial resistance to antibiotics as an outcome as was the case in subquestion 4.f). This suggestion also had been made during the first conference call by one of the technical experts.
During an episode of uncomplicated acute otitis media (AOM) that is initially managed WITHOUT any active intervention (pharmacologic or surgical) other than topical or systemic medications (that do not contain antibiotics) given for symptomatic relief, (e.g., analgesics, antipyretics, antihistamines, decongestants, ear or nose drops), what proportion of children have the outcomes delineated in the scope of the evidence report?
To what degree are the above outcomes attributable to the influencing factors delineated in the Scope of the Evidence Report?
Are antibiotics effective (in terms of statistical significance and magnitude of absolute clinical benefit above and beyond placebo/observational/no treatment/natural history) in the initial1 treatment of uncomplicated AOM with respect to the outcomes delineated in the scope of the evidence report?
When antibiotics are used in the initial1 treatment of uncomplicated AOM, which of the influencing factors delineated in the scope of the evidence report are associated with better outcomes compared to placebo/observational/no treatment/natural history?
Does the specific antibiotic regimen make a difference?
(Antibiotic class) Is treatment with antibiotics of broader coverage than amoxicillin or trimethoprim sulfa more effective or result in less total cost in the initial1 treatment of uncomplicated AOM?
(Antibiotic class) What is the utility of oral fluoroquinolones in the initial1 treatment of uncomplicated AOM in childhood? What are the side effects?
(Dose of antibiotic) What is the value of using 60-80 mg/kg/d of amoxicillin or amoxicillin-clavulanate vs. the standard 40 mg/kg/d in the initial1 treatment of uncomplicated AOM?
(Schedule of antibiotic) Is twice a day high-dose amoxicillin therapy as effective as three times a day amoxicillin therapy in the initial1 treatment of uncomplicated AOM?
(Length of treatment) What is the comparative effectiveness of short- vs. long-term antibiotic therapy in children younger than 2 years of age and those older than 2 years of age in the initial1 treatment of uncomplicated AOM?
It was pointed out by one of the technical experts that unless we allowed studies that included children who had used "topical or systemic medications (that do not contain antibiotics) given for symptomatic relief (e.g., analgesics, antipyretics, antihistamines, decongestants, ear or nose drops)," we would have to "exclude nearly every published article from consideration." We have thus reworded Question 1 and will stratify in the analysis, if possible, to look at studies that truly have no intervention and those that included children who had used medications for symptomatic relief. Medications for symptomatic relief with commercial names in parentheses would include: (List is not exhaustive.) (From Physicians Desk Reference, 1998, Taketomo, 1999)
analgesics: (See ear drops)
acetaminophen (Anacin-3, Datril, Panadol, Tempra, Tylenol)
ibuprofen (Advil, Motrin, PediaProfen)
antipyretics:
acetaminophen (Anacin-3, Datril, Panadol, Tempra, Tylenol)
ibuprofen (Advil, Motrin, PediaProfen)
antihistamines:
astemizole (Hismanal)
cetirizine hydrochloride (Zyrtec)
chlorpheniramine maleate (Chlor-Trimeton)
cyproheptadine hydrochloride (Periactin)
dimenhydrinate (Dramamine)
diphenhydramine (Benadryl)
hydroxyzine (Atarax, Vistaril)
loratadine (Claritin)
meclizine hydrochloride (Antivert, Bonine)
phenindamine tartrate (Nolahist)
promethazine hydrochloride (Phenergan)
terfenadine (Seldane)
decongestants:
phenylpropanolamine hydrochloride (Propagest)
pseudoephedrine hydrochloride (Sudafed)
antihistamine and/or decongestant combinations:
acrivastine and pseudoephedrine hydrochloride (Semprex-D)
azatadine maleate and pseudoephedrine sulfate (Trinalin)
brompheniramine maleate and phenylpropanolamine hydrochloride (Dimetapp)
brompheniramine maleate and pseudoephedrine hydrochloride (Bromfed, Bromfed-PD)
chlorpheniramine maleate and pseudoephedrine hydrochloride (Atrohist Pediatric, Codimal-L.A., Codimal-L.A.-HALF, Fedahist Gyrocaps, Kronofed-A, Kronofed-A-Jr.)
chlorpheniramine tannate and phenylephrine tannate and pyrilamine tannate (Atrohist)
phenindamine tartrate and chlorpheniramine maleate and phenylpropanolamine hydrochloride (Nolamine)
promethazine and phenylephrine (Phenergan VC)
triprolidine hydrochloride and pseudoephedrine hydrochloride (Actifed)
otic preparations:
includes analgesic/local anesthestic
antipyrine (cerumenolytic) and benzocaine (Aurafair, Auralgan, Auroto)
benzocaine (Americaine Otic)
phenylephrine hydrochloride (decongestant) and benzocaine (Tympagesic Otic Solution)
includes steroid
dexamethasone sodium phosphate (Decadron Phosphate)
hydrocortisone and acetic acid in propylene glycol vehicle (VoSoL HC)
non-antibiotic antimicrobial
acetic acid in aqueous aluminum acetate otic solution (Otic Domeboro)
acetic acid in propylene glycol vehicle (VoSoL)
cerumenolytic
carbamide peroxide (Debrox, Gly-Oxide)
triethanolamine polypeptide oleate-condensate (Cerumenex)
nasal preparations:
antihistamines or decongestants
azelastine hydrochloride (Astelin)
naphazoline hydrochloride (AK-Con, Albalon, Liquifilm, Naphcon, Naphcon Forte, Vasocon Regular)
oxymetazoline hydrochloride (Afrin)
phenylephrine hydrochloride (Neo-Synephrine)
steroids
beclomethasone diproprionate (Beconase, Beconase AQ, Vancenase, Vancenase AQ, Vancenase AQ 84 mcg)
budesonide (Rhinocort)
dexamethasone sodium phosphate (Dexacort Phosphate)
flunisolide (Nasalide, Nasarel)
fluticasone proprionate (Flonase)
triamcinolone Acetomide (Nasacort, Nasacort AQ)
The phrase "in the initial1 treatment of uncomplicated AOM" was inadvertently omitted from questions 4. c) and 4. e) and has been added.
The majority of the technical experts felt that an episode of uncomplicated AOM may be considered distinct from a previous episode of AOM and eligible for "initial" treatment if the most recent course of antibiotic ended 4 weeks prior to the episode of AOM in question or if there is documentation by an examiner that a prior episode of AOM has been cleared.
During an episode of uncomplicated acute otitis media (AOM) that is initially managed WITHOUT any active intervention (pharmacologic or surgical) other than topical or systemic medications (that do not contain antibiotics) given for symptomatic relief, (e.g)., analgesics, antipyretics, antihistamines, decongestants, ear or nose drops), what proportion of children have the outcomes delineated in the scope of the evidence report?
To what degree are the above outcomes attributable to the influencing factors delineated in the scope of the evidence report?
Are antibiotics effective (in terms of statistical significance and magnitude of absolute clinical benefit above and beyond placebo/observational/no treatment/natural history) in the initial1 treatment of uncomplicated AOM with respect to the outcomes delineated in the scope of the evidence report?
When antibiotics are used in the initial1 treatment of uncomplicated AOM, which of the influencing factors delineated in the scope of the evidence report are associated with better outcomes compared to placebo/observational/no treatment/natural history?
Does the specific antibiotic regimen make a difference?
(Antibiotic class) Is treatment with antibiotics other than amoxicillin or trimethoprim sulfa more effective or result in less total cost in the initial1 treatment of uncomplicated AOM?
(Antibiotic class) What is the utility of oral fluoroquinolones in the initial1 treatment of uncomplicated AOM in childhood? What are the side effects?
(Dose of antibiotic) What is the value of using > 60 mg/kg/d of amoxicillin or amoxicillin-clavulanate vs. the standard 40 mg/kg/d in the initial1 treatment of uncomplicated AOM?
(Schedule of antibiotic) Is twice a day high-dose amoxicillin therapy as effective as three times a day amoxicillin therapy in the initial1 treatment of uncomplicated AOM?
(Length of treatment) What is the comparative effectiveness of short- vs. long-term antibiotic therapy in children younger than 2 years of age and those older than 2 years of age in the initial1 treatment of uncomplicated AOM?
During the 3/26/99 conference call, the technical expert panel agreed to replace the phrase "of broader coverage" in the 2/24/99 version with the word "other."
During the 3/26/99 conference call, the technical expert panel agreed to change the dosage "60-80 mg/kg/d" in the 2/24/99 version with "> 60 mg/kg/d."
One of the tasks arising out of the second conference call on 12/1/98 was to establish a definition for the term acute otitis media. The following definition for acute otitis media is found in Bluestone and Klein (1996):
"Acute otitis media is the rapid onset of signs and symptoms of acute infection within the middle ear."
Bluestone and Klein (1996) further state:
"One or more local or systemic signs are present: otalgia (or pulling of the ear in the young infant), otorrhea, fever, recent onset of irritability, anorexia, vomiting, or diarrhea. The tympanic membrane is full or bulging, is opaque, and has limited or no mobility to pneumatic otoscopy -- indicative of middle-ear effusion."
Bluestone and Klein (1996) define middle ear effusion as follows:
"Middle-ear effusion is liquid in the middle ear."
Dr. Rosenfeld has previously suggested that the presence of middle ear effusion be a criterion for diagnosing acute otitis media. Dr. Marcy and Dr. Casselbrant suggested that vomiting and diarrhea not be included among the eligible local or systemic signs or symptoms for diagnosis of acute otitis media.
Dr. Marcy recommended the deletion of anorexia and the addition of hearing loss. Dr. Casselbrant suggested that the diagnosis be based on the presence of one sign and one symptom. Based on these recommendations, the following definition for acute otitis media is proposed:
Acute otitis media is the
rapid onset of
signs of middle ear effusion and inflammation accompanied by
clinical findings which generally include one or more of the following:
otalgia (or pulling of ear in an infant)
otorrhea
irritability
fever
hearing loss (older children)
Acute otitis media is defined as
presence of middle ear effusion as demonstrated by the actual presence of fluid in the middle ear as diagnosed by tympanocentesis or indicated by limited or absent mobility of the tympanic membrane as diagnosed by pneumatic otoscopy, tympanogram, or acoustic reflectometry with or without the following:
opacification, not including erythema
a full or bulging tympanic membrane
hearing loss
rapid onset (over the course of 48 hours)
OF
one or more of the following signs or symptoms:
otalgia (or pulling of ear in an infant)
otorrhea
irritability in infant or toddler
fever
The changes were made based on input from technical and internal experts.
It appears that there has been confusion between creating a definition of AOM and creating criteria for diagnosing AOM. We need to do both. We need a definition to establish the criteria by which we feel AOM should be diagnosed. We will then use our criteria for diagnosing AOM to assess how closely the studies in our evidence analysis approximate our definition and each other. (See point 3 below.) Because the issue of the definition and diagnosis of AOM was not one of the key questions chosen by the technical expert panel for analysis, we will not do a formal evidence analysis of the criteria for diagnosis but will instead rely on the consensus of the technical expert panel.
We revised the definition as follows: The criteria for diagnosis should specify how middle ear effusion, rapid onset of clinical signs and symptoms, and clinical signs and symptoms are established.
Most would agree that tympanocentesis is the gold standard for establishing the presence of fluid in the middle ear. The majority of the technical expert panel agreed with the decision to include limited or absent mobility of the tympanic membrane as a sign of middle ear effusion, and this decision is supported by the findings of a study by Karma, Penttila, Sipila, et al., 1989, and indirectly by the recommendation of the Otitis Media with Effusion Guidelines (Stool, Berg, Berman, et al., 1994a) to utilize pneumatic otoscopy as the primary means for diagnosing middle ear effusion. The technical expert panel also agreed to adding change from normal color and translucency as a sign of middle ear effusion, and one technical expert wanted to specify this finding to "red or white opacification" and to add "full or bulging tympanic membrane" as well. Erythema of the tympanic membrane, however, is not specific for AOM (Karma, Penttila, Sipila, et al., 1989). Cloudiness or opacification of the tympanic membrane, excluding erythema, and bulging of the tympanic membrane have been shown to be associated with middle ear effusion with and without the acute symptoms listed in criterion three (Karma, Penttila, Sipila, et al., 1989). Several of our technical experts pointed out that any signs or symptoms of middle ear effusion in criterion three, such as hearing loss, should more appropriately be placed in the first criterion. The technical experts were split, however, on whether to retain hearing loss in the definition. For this reason, hearing loss was moved into the first criterion as a non absolute finding because its presence would seem a confirmation of the presence of middle ear effusion that should be established by the more specific finding of middle ear fluid aspirated by tympanocentesis or limited or decreased mobility of the tympanic membrane.
For rapid onset, the majority of the technical expert panel felt that rapid onset of symptoms would be within 48 hours.
It is not clear from either the original definition in Bluestone and Klein, 1996, nor from any of the comments from the technical experts what specific information is being added by the clinical signs and symptoms in the third criterion. In Bluestone and Klein, 1996, there is reference to the signs and symptoms being indicative of inflammation in one part of the chapter and indicative of acute infection in another part of the chapter. Certainly an acute infection would lead to inflammation. On the other hand, can one assume that the presence of inflammation necessarily implies the presence of infection? The Otitis Media with Effusion Guidelines state that AOM is "inflammation of the middle ear with signs or symptoms of middle ear infection" (Stool, Berg, Berman, et al., 1994a) or "fluid in the middle ear accompanied by signs or symptoms of ear infection" (Stool, Berg, Berman, et al., 1994b) and that otitis media with effusion is "fluid in the middle ear without signs or symptoms of ear infection" (Stool, Berg, Berman, et al., 1994a). On the other hand, Rosenfeld (1996) states that the term "ear infection" "applies to AOM [acute otitis media] and OME [otitis media with effusion], because pathogenic bacteria generally are present in the middle ear with both conditions." It appears that the experts disagree whether the presence of infection is the distinguishing point between the two otitis media conditions that are perhaps the most common to be encountered, AOM and AME. If it were true that infection was not the distinguishing feature, another approach would be to use the clinical signs and symptoms to indicate severity of illness and establish a severity above which AOM is diagnosed and below which OME is diagnosed. For the purpose of this study, we will simply note this dilemma of criterion three and list those signs or symptoms that traditionally have been listed as being indicative of AOM. Because a majority of the technical expert panel feel that gastrointestinal findings such as anorexia, nausea, vomiting, and diarrhea should not be included in the list of clinical findings, they are no longer included in the signs and symptoms that would establish a diagnosis of AOM in conjunction with middle ear effusion. One technical expert did point out that nausea and vomiting, though immediate gastrointestinal symptoms, may be indicative of effects on the vestibular system; therefore, reference to gastrointestinal findings, as found in most traditional definitions of AOM, is retained in the present definition. The project staff also note that all the signs and symptoms in criterion three are observable, either objectively or subjectively, by the patient or guardian and, therefore, would help to establish the rapid onset required in criterion two.
The definition of AOM will be used to evaluate the appropriateness of the studies for our topic in the following way: "well defined" when the study used the same primary criteria as in our definition; "moderately defined" when the study used some but not all of the primary criteria as in our definition; "undefined" when the study did not use any of the criteria or did not specify any criteria used. We will categorize the studies according to these criteria and analyze them accordingly.
Acute otitis media is defined as
presence of middle ear effusion as demonstrated by the actual presence of fluid in the middle ear as diagnosed by tympanocentesis or the physical presence of liquid in the external ear canal as a result of tympanic membrane perforation or indicated by limited or absent mobility of the tympanic membrane, excluding the retracted tympanic membrane, as diagnosed by pneumatic otoscopy, tympanogram, or acoustic reflectometry with or without the following:
opacification, not including erythema
a full or bulging tympanic membrane
hearing loss
rapid onset (over the course of 48 hours1)
OF
one or more of the following signs or symptoms:
The majority of the technical expert panel felt that limited or absent mobility of the tympanic membrane in light of a retracted tympanic membrane was not indicative of fluid in the middle ear. In addition, the project staff recognized that in some cases of AOM tympanic membrane perforation may have occurred and neither tympanocentesis nor testing for tympanic membrane mobility would be possible. It was recognized that in those cases the presence of fluid in the external ear canal also would confirm the presence of a middle ear effusion.
2. One of the technical experts felt, based on the 1994 Otitis Media with Effusion Guidelines, that acoustic reflectometry is not a valid diagnostic procedure to establish the presence of middle ear effusion. The project staff has determined that "The [OME] Panel judged the evidence in support of acoustic reflectometry to be insufficient to make a recommendation regarding use of this test in screening for or diagnosis of otitis media with effusion." (Stool, Berg, Berman, et al., 1994b) A recent publication, however, found that compared to the presence of middle ear effusion at time of surgery in a population with a 58% prevalence of middle ear effusion, acoustic reflectometry had a sensitivity of 95%, specificity of 31%, positive predictive value of 66%, and negative predictive value of 83% when the cutoff level was set at an angle of 95; and a sensitivity of 38%, specificity of 93%, positive predictive value of 88%, and a negative predictive value of 52% when the cutoff level was set at an angle of 49. (Barnett, Klein, Hawkins, et al., 1998) Barnett, Klein, Hawkins, et al. (1998) also found the comparable indices for tympanometry with a cutoff level of 0.2 compliance peak to be sensitivity 54%, specificity 75%, positive predictive value 78%, and negative predictive value 59%; and with a cutoff level of 0.1 compliance peak to be sensitivity 54%, specificity 84%, positive predictive value 82%, and negative predictive value 56%. Based on this study, it would seem appropriate to keep acoustic reflectometry as a viable diagnostic tool to establish the presence of middle ear effusion because it performed as well as tympanometry which the OME Guidelines panel had previously deemed an appropriate diagnostic tool.
The majority of the technical expert panel also felt that the 48-hour period of rapid onset was defined as the time from the onset of acute signs or symptoms first noted by the parent or guardian to contact with the health system.
One of the technical experts pointed out that the fourth revision of the definition would not work for the following case: "...a child with stable OME who develops febrile rotavirus diarrhea meets the definition (whether they have any of the...a, b, or c findings). I'm not sure how that can work." The project staff are in agreement with this assessment and also feel that irritability is nonspecific. The project staff is proposing that neither "irritability in the infant or toddler" nor "fever" can stand alone to meet criteria 3 but must exist in association with a sign or symptom directly referable to the ear, (i. e., otalgia or otorrhea).
The project staff have decided to delete reference to diarrhea from the definition because there is no apparent pathophysiologic connection between AOM and diarrhea as had been previously pointed out by many of the technical expert panel members.
Acute otitis media is defined as
presence of middle ear effusion as demonstrated by the actual presence of fluid in the middle ear as diagnosed by tympanocentesis or the physical presence of liquid in the external ear canal as a result of tympanic membrane perforation or indicated by limited or absent mobility of the tympanic membrane as diagnosed by pneumatic otoscopy, tympanogram, or acoustic reflectometry with or without the following:
opacification, not including erythema
a full or bulging tympanic membrane
hearing loss
rapid onset (over the course of 48 hours1)
OF
one or more of the following signs or symptoms:
otalgia (or pulling of ear in an infant)
otorrhea
irritability in the infant or toddler
fever
During the 3/26/99 conference call, the technical expert panel agreed to delete the phrase "excluding the retracted tympanic membrane" from the fifth revision of the definition.
During the 3/26/99 conference call, the technical expert panel agreed to delete footnote 2 from the fifth revision of the definition. The experts felt that with the required presence of middle ear effusion, "irritability" and "fever" were both specific enough for criterion 3.
During the 3/26/99 conference call, the technical expert
panel expressed the need for a "sound bite" definition of
AOM. The project staff agrees that the complexity of the
above definition lies in the embedding of criteria within
the structure of the definition. The project staff proposes
that the definition without embedded criteria is as follows:
Acute otitis media is the presence of middle ear
effusion in conjunction with the rapid onset of one
or more signs or symptoms of inflammation of the
middle ear.
| Disease entity: | Uncomplicated Acute Otitis Media1 |
| Exclude: patients with immunodeficiencies and craniofacial deficiencies including cleft palate. | |
| Patient population: | Age 4 weeks to 18 years |
| Setting: | All types of providers and practice settings |
| Intervention: | Observation/no intervention/natural history/placebo2 |
| Antibiotic treatment (all classes, schedule, dosage, length, and mode)3 | |
| Influencing factors: | Demographic |
| Age of child | |
| Gender | |
| Ethnicity/race | |
| Environmental | |
| Presence of sibling(s) | |
| Attendance at day care center | |
| Sibling(s) in day care center | |
| Feeding mode-bottle vs. breast | |
| Pacifier use | |
| Tobacco smoke exposure | |
| History and/or presence of ear infections in parents or siblings | |
| Signs and symptoms by history | |
| Prior history of recurrent AOM | |
| Otalgia (or pulling of ear in an infant) | |
| Otorrhea | |
| Irritability | |
| Fever | |
| Hearing loss (older children) | |
| Severity of initial symptoms | |
| Season of the year | |
| Physical findings | |
| Tympanic membrane (TM) inflammation | |
| Retracted TM | |
| Purulent otorrhea | |
| Middle ear effusion | |
| Other clinical factors | |
| Underlying predisposing problem (viral infection) | |
| Prior antibiotic use | |
| Concurrent use of analgesics | |
| Multiple previous episodes | |
| Hearing and/or speech problems | |
| Atopy or allergy | |
| Craniofacial problems | |
| Parent/caretaker | |
| Parent/caretaker availability | |
| Parent/caretaker preference | |
| Parent/caretaker education | |
| Provider | |
| Type of provider | |
| Experience | |
| Setting | |
| Monitoring system of course of antibiotic treatment or during episode | |
| Frequency (none, daily, every other day) | |
| Primary person (parent or provider) | |
| Type (tympanometry, acoustic reflectometry, pneumatic otoscopy) | |
| Cost | |
| Cost of treatment | |
| Cost of total care | |
| Outcome measures: | Within 48 hours |
| Presence/absence of pain/otorrhea/irritability/fever/hearing loss | |
| Presence/absence of discharge/inflammation of TM | |
| Presence/absence of acute suppurative complications/secondary complications | |
| Mastoiditis | |
| Petrositis | |
| Acute suppurative labyrinthitis | |
| Extradural abscess | |
| Subdural abscess (empyema) | |
| Brain abscess | |
| Meningitis | |
| Lateral sinus thrombosis | |
| Presence/absence of all signs/symptoms except middle ear effusion | |
| Cost of care | |
| Presence/absence of resistant bacteria | |
| Between 3-7 days | |
| Presence/absence of pain/otorrhea/irritability/fever/hearing loss | |
| Presence/absence of discharge/inflammation of TM | |
| Presence/absence of acute suppurative complications/secondary complications | |
| Mastoiditis | |
| Petrositis | |
| Acute suppurative labyrinthitis | |
| Extradural abscess | |
| Subdural abscess (empyema) | |
| Brain abscess | |
| Meningitis | |
| Lateral sinus thrombosis | |
| Presence/absence of all signs/symptoms except middle ear effusion | |
| Cost of care | |
| Presence/absence of resistant bacteria | |
| Between 7-14 days | |
| Presence/absence of pain/otorrhea/irritability/fever/hearing loss | |
| Presence/absence of discharge/inflammation of TM | |
| Presence/absence of acute suppurative complications/secondary complications | |
| Mastoiditis | |
| Petrositis | |
| Acute suppurative labyrinthitis | |
| Extradural abscess | |
| Subdural abscess (empyema) | |
| Brain abscess | |
| Meningitis | |
| Lateral sinus thrombosis | |
| Presence/absence of all signs/symptoms except middle ear effusion | |
| Cost of care | |
| Presence/absence of resistant bacteria | |
| Between 14 days--3 months | |
| Presence/absence of asymptomatic middle ear effusion | |
| Presence/absence of acute suppurative complications (mastoiditis) | |
| Presence/absence of recurrence | |
| Presence/absence of acute suppurative complications/secondary complications | |
| Mastoiditis | |
| Petrositis | |
| Acute suppurative labyrinthitis | |
| Extradural abscess | |
| Subdural abscess (empyema) | |
| Brain abscess | |
| Meningitis | |
| Lateral sinus thrombosis | |
| Presence/absence of hearing problems | |
| Presence/absence of speech problems | |
| Cost of total care | |
| Presence/absence of resistant bacteria | |
| Greater than 3 months (to be determined) | |
| Time period: | 1966- 1998 |
| Literature source: | MEDLINE |
| EMBASE | |
| HealthSTAR | |
| CINAHL (nursing and allied paramedical professionals) | |
| Cochrane Database of Systematic Reviews | |
| Database of Abstracts and Reviews of Effectiveness (English National Health Services Center for Reviews and Dissemination) | |
| References of published articles | |
| Language: | English and foreign Languages |
| Study design: | Randomized controlled trials, blinded and unblinded |
| Non-randomized controlled trials, blinded and unblinded | |
| Prospective cohort studies (for observational/no treatment) | |
| Retrospective cohort studies | |
| Case-control studies |
Acute otitis media is defined as 1) rapid onset of 2) signs of middle ear effusion and and inflammation accompanied by 3) clinical findings which generally include one or more of the following: a) otalgia (or pulling of ear in an infant), b) otorrhea, c) irritability, d) fever, and e) hearing loss (older children). Uncomplicated AOM is defined as AOM limited to the middle ear cleft.
Observational treatment or no intervention is defined as initial management of the disease WITHOUT antibiotic streatment with or without a monitoring protocol. Placebo treatment is defined as initial management of the disease with a placebo in place of antibiotics in randomized controlled trials. Natural history is defined as the natural course of the disease without any intervention by provider or parent.
For Question 3 all antibiotic regimens are aggregated, and for Question 4 the antibiotic regimens are specified as per the subquestions.
| Disease entity: | Uncomplicated Acute Otitis Media1 |
| Exclude: patients with immunodeficiencies and craniofacial deficiencies including cleft palate | |
| Patient population: | Age 4 weeks to 18 years |
| Setting: | All types of providers and practice settings |
| Intervention: | Observation/no intervention/natural history/placebo2 |
| Antibiotic treatment (all classes, schedule, dosage, length, and mode)3 | |
| Influencing factors4: | Demographic |
| Age of child | |
| Gender | |
| Ethnicity/race | |
| Environmental | |
| Presence of sibling(s) | |
| Attendance at day care center | |
| Sibling(s) in day care center | |
| Feeding mode-bottle vs. breast | |
| Pacifier use | |
| Tobacco smoke exposure | |
| History and/or presence of ear infections in parents or siblings | |
| Season of the year | |
| Symptoms by history | |
| Otalgia and severity | |
| Hearing deficit and severity | |
| Signs/physical findings | |
| Pulling of ear in an infant | |
| Otorrhea | |
| Irritability | |
| Fever | |
| Hearing loss | |
| Tympanic membrane (TM) inflammation | |
| Retracted TM | |
| Purulent otorrhea | |
| Middle ear effusion | |
| Other clinical factors | |
| Otitis prone5 (prior history of recurrent AOM, multiple previous episodes) | |
| Underlying predisposing problem (viral infection) | |
| Prior antibiotic use and when used | |
| Concurrent use of analgesics | |
| Prior hearing deficit | |
| Inability to express symptoms | |
| Atopy or allergy | |
| Presence of tube | |
| Parent/caretaker | |
| Parent/caretaker availability | |
| Parent/caretaker preference | |
| Parent/caretaker education | |
| Examiner | |
| Type of examiner (family physician, otolaryngologist, pediatrician, nurse practitioner, physician assistant, etc.) | |
| Skill to diagnose (validated examiner/observer) | |
| Setting (public, private, PPO, HMO, etc.) | |
| Monitoring during episode or course of therapy | |
| When | |
| Frequency (none, daily, every other day) | |
| Primary person (parent or provider) | |
| Type (tympanometry, acoustic reflectometry, pneumatic otoscopy) | |
| Cost | |
| Cost of treatment |
Acute otitis media is defined as 1) presence of middle ear effusion as demonstrated by the actual presence of fluid in the middle ear as diagnosed by tympanocentesis or indicated by limited or absent mobility of the tympanic membrane as diagnosed by pneumatic otoscopy, tympanogram, or acoustic reflectometry with or without the following: a) opacification, not including erythema, b) a full or bulging tympanic membrane, or c) hearing loss AND 2) rapid onset (over the course of 48 hours) OF 3) one or more of the following clinical signs or symptoms: a) otalgia (or pulling of ear in an infant), b) otorrhea, c) irritability in the infant or toddler, or d) fever, with or without anorexia, nausea, vomiting, or diarrhea. Uncomplicated AOM defined as AOM limited to the middle ear cleft.
Observational treatment or no intervention is defined as initial management of the disease WITHOUT antibiotic treatment with or without a monitoring protocol. Placebo treatment is defined as initial management of the disease with a placebo in place of antibiotics in randomized controlled trials. Natural history is defined as the natural course of the disease without any intervention by provider or parent.
For Question 3 all antibiotic regimens are aggregated, and for Question 4 the antibiotic regimens are specified as per the subquestions.
An influencing factor is defined as a characteristic of the patient or the environment or the health care delivery system that may affect the natural history of the disease or the outcome(s) of the intervention of interest. The list of influencing factors has been reorganized and contains several additional factors since the last revision.
To be defined by polling technical experts.
| Outcome measures6: | Time at which outcomes are measured | ||||
|---|---|---|---|---|---|
| <48hrs | 3-7d | 7-14d | 14 d-3m | >3 m | |
| Presence/absence of | |||||
| pain | x | x | x | x | x |
| otorrhea | x | x | x | x | x |
| irritability | x | x | x | x | x |
| fever | x | x | x | x | x |
| anorexia | x | x | x | x | x |
| nausea (disequilibrium) | x | x | x | x | x |
| vomiting | x | x | x | x | x |
| diarrhea | x | x | x | x | x |
| Presence/absence of | |||||
| limited or absent mobility of TM | x | x | x | x | x |
| hearing deficit | x | x | x | x | |
| speech problem | x | ||||
| Presence/absence of | |||||
| recurrence of AOM | x | x | |||
| Presence/absence of | |||||
| acute suppurative complications/ | |||||
| secondary complications | |||||
| mastoiditis | x | x | x | x | x |
| petrositis | x | x | x | x | x |
| acute suppurative labyrinthitis | x | x | x | x | x |
| extradural abscess | x | x | x | x | x |
| subdural abscess (empyema) | x | x | x | x | x |
| brain abscess | x | x | x | x | x |
| lateral sinus thrombosis | x | x | x | x | x |
| Presence/absence of | |||||
| side/adverse effects from meds | x | x | x | x | x |
| Presence/absence of | |||||
| resistant bacteria | x | x | x | x | x |
| Cost of care | |||||
| direct cost | x | x | x | x | x |
| indirect cost | x | x | x | x | x |
| total cost | x | x | x | x | x |
| Quality of life | x | x | x | x | x |
The outcome measures listed here define the scope of the project. The time point at which each outcome measure is considered relevant is marked by "x." This outcome-time matrix will be used as a guide for our evidence analysis in the context of the key questions.
| Time period: | 1966- 1999 |
| Literature source: | MEDLINE |
| EMBASE | |
| HealthSTAR | |
| CINAHL (nursing and allied paramedical professionals) | |
| BIOSYS | |
| Cochrane Database of Systematic Reviews | |
| Database of Abstracts and Reviews of Effectiveness (English National Health Services Center for Reviews and Dissemination) | |
| References of published articles | |
| Language: | English and Foreign languages |
| Study design: | Randomized controlled trials, blinded and unblinded |
| Non-randomized controlled trials, blinded and unblinded | |
| Prospective cohort studies (for observation/No treatment) | |
| Retrospective cohort studies (for observation/no treatment) | |
| Case-control studies |
| Disease Entity: | Uncomplicated Acute Otitis Media1 |
| Exclude: patients with immunodeficiencies and craniofacial deficiencies including cleft palate | |
| Patient Population: | Age 4 weeks to 18 years |
| Setting: | All types of providers and practice settings |
| Intervention: | Observation/no intervention/natural history/placebo2 |
| Antibiotic treatment (all classes, schedule, dosage, length, and mode)3 | |
| Influencing factors4: | Demographic |
| Age of child | |
| Gender | |
| Ethnicity/race | |
| Environmental | |
| Presence of sibling(s) | |
| Attendance at day care center | |
| Sibling(s) in day care center | |
| Feeding mode-bottle vs. breast | |
| Pacifier use | |
| Tobacco smoke exposure | |
| History and/or presence of ear infections in parents or siblings | |
| Season of the year | |
| Symptoms by history | |
| Otalgia and severity | |
| Hearing deficit and severity | |
| Signs/Physical findings | |
| Pulling of ear in an infant | |
| Otorrhea | |
| Irritability | |
| Fever | |
| Hearing loss | |
| Tympanic membrane (TM) inflammation | |
| Retracted TM | |
| Purulent otorrhea | |
| Middle ear effusion | |
| Other clinical factors | |
| Otitis prone5 (prior history of recurrent AOM/multiple previous episodes) | |
| Underlying predisposing problem (viral infection) | |
| Prior antibiotic use and when used | |
| Concurrent use of analgesics | |
| Prior hearing deficit | |
| Inability to express symptoms | |
| Atopy or allergy | |
| Presence of tube | |
| Parent/caretaker | |
| Parent/caretaker availability | |
| Parent/caretaker preference | |
| Parent/caretaker education | |
| Examiner | |
| Type of examiner (family physician, otolaryngologist, pediatrician, nurse practitioner, physician assistant, etc.) | |
| Skill to diagnose (validated examiner/observer) | |
| Setting (public, private, PPO, HMO, etc.) | |
| Monitoring during episode or course of therapy | |
| When | |
| Frequency (none, daily, every other day) | |
| Primary person (parent or provider) | |
| Type (tympanometry, acoustic reflectometry, pneumatic otoscopy) | |
| Cost | |
| Cost of treatment |
Acute otitis media is defined as 1) presence of middle ear effusion as demonstrated by the actual presence of fluid in the middle ear as diagnosed by tympanocentesis or the physical presence of liquid in the external ear canal as a result of tympanic membrane perforation or indicated by limited or absent mobility of the tympanic membrane, excluding the retracted tympanic membrane, as diagnosed by pneumatic otoscopy, tympanogram, or acoustic reflectometry with or without the following: a) opacification, not including erythema, b) a full or bulging tympanic membrane, or c) hearing loss, and 2) rapid onset (over the course of 48 hours) or 3) one or more of the following signs or symptoms: 1) otalgia (or pulling of ear in an infant), b) otorrhea, c) irritability in the infant or toddler2, or fever2with or without anorexia, nausea, vomiting, or diarrhea. (Rapid onset is defined as less-than or equal to 48 hours from the onset of acute signs or symptoms first noted by the parent or guardian to contact with the health system. 2Irritability in the infant or toddler and fever must be associated with either otalgia or otorrhea to fulfill criteria 3.) Uncomplicated AOM is defined as AOM limited to the middle ear cleft. The issue of the role acoustic reflectometry as a legitimate diagnostic tool for the establishment of middle ear effusion is not resolved.
Observational treatment or no intervention is defined as initial management of the disease WITHOUT antibiotic treatment with or without a monitoring protocol. Placebo treatment is defined as initial management of the disease with a placebo in place of antibiotics in randomized controlled trials. Natural history is defined as the natural course of the disease without any intervention by provider or parent.
For Question 3 all antibiotic regimens are aggregated, and for Question 4 the antibiotic regimens are specified as per the subquestions.
An influencing factor is defined as a characteristic of the patient or the environment or the health care delivery system that may affect the natural history of the disease or the outcome(s) of the intervention of interest.
The otitis-prone child is defined as the child who has had three episodes of AOM in a 6-month period or four episodes of AOM in a 12-month period. The episodes of AOM should be well-documented. Each episode of AOM should preferably have been separated by at least 4 weeks from the previous episode of AOM and treatment course or documented on followup to have cleared.
| Outcome Measures6: | Time at which outcomes are measured | ||||
|---|---|---|---|---|---|
| <48hrs | 3-7d | 7-14 d | 14d-3m | >3m | |
| Presence/absence of | |||||
| pain. | x | x | x | x | x |
| otorrhea | x | x | x | x | x |
| irritability | x | x | x | x | x |
| fever | x | x | x | x | x |
| anorexia | x | x | x | x | x |
| nausea (disequilibrium) | x | x | x | x | x |
| vomiting | x | x | x | x | x |
| diarrhea | x | x | x | x | x |
| Presence/absence of | |||||
| limited or absent mobility of TM | x | x | x | x | x |
| hearing deficit | x | x | x | x | |
| speech problem | x | ||||
| Presence/absence of | |||||
| recurrence of AOM | x | x | |||
| Presence/absence of | |||||
| acute suppurative complications/ | |||||
| secondary complications | |||||
| mastoiditis | x | x | x | x | x |
| petrositis | x | x | x | x | x |
| acute suppurative labyrinthitis | x | x | x | x | x |
| extradural abscess | x | x | x | x | x |
| subdural abscess (empyema) | x | x | x | x | x |
| brain abscess | x | x | x | x | x |
| lateral sinus thrombosis | x | x | x | x | x |
| Presence/absence of | |||||
| side/adverse effects from meds | x | x | x | x | x |
| Presence/absence of | |||||
| resistant bacteria | x | x | x | x | x |
| Cost of care | |||||
| direct cost | x | x | x | x | x |
| indirect cost | x | x | x | x | x |
| total cost | x | x | x | x | x |
| Quality of life | x | x | x | x | x |
The outcome measures listed here define the scope of the project. The time point at which each outcome measure is considered relevant is marked by "x." This outcome-time matrix will be used as a guide for our evidence analysis in the context of the key questions.
| Time Period: | 1966- 1998 |
| Literature Source: | MEDLINE |
| EMBASE | |
| HealthSTAR | |
| CINAHL (nursing and allied paramedical professionals) | |
| BIOSYS | |
| Cochrane Database of Systematic Reviews | |
| Database of Abstracts and Reviews of Effectiveness (English National Health Services Center for Reviews and Dissemination) | |
| References of published articles | |
| Language: | English and foreign languages |
| Study Design: | Randomized controlled trials, blinded and unblinded |
| Non-randomized controlled trials, blinded and unblinded | |
| Prospective cohort studies (for observation/no treatment) | |
| Retrospective cohort studies (for observation/no treatment) | |
| Case-control studies |
| Disease Entity: | Uncomplicated Acute Otitis Media1 |
| Exclude: patients with immunodeficiencies and craniofacial deficiencies including cleft palate | |
| Patient Population: | Age 4 weeks to 18 years |
| Setting: | All types of providers and practice settings |
| Intervention: | Observation/no intervention/natural history/placebo2 |
| Antibiotic treatment (all classes, schedule, dosage, length, and mode)3 | |
| Influencing factors4: | Demographic |
| Age of child | |
| Gender | |
| Ethnicity/race | |
| Environmental | |
| Presence of sibling(s) | |
| Attendance at day care center | |
| Sibling(s) in day care center | |
| Feeding mode-bottle vs. breast | |
| Pacifier use | |
| Tobacco smoke exposure | |
| History and/or presence of ear infections in parents or siblings | |
| Season of the year | |
| Symptoms by history | |
| Otalgia and severity | |
| Hearing deficit and severity | |
| Signs/physical findings | |
| Pulling of ear in an infant | |
| Otorrhea | |
| Irritability | |
| Fever | |
| Hearing loss | |
| Tympanic membrane (TM) inflammation | |
| Retracted TM | |
| Purulent otorrhea | |
| Middle ear effusion | |
| Other clinical factors | |
| Otitis prone5 (prior history of recurrent AOM/multiple previous episodes) | |
| Underlying predisposing problem (viral infection) | |
| Prior antibiotic use and when used | |
| Concurrent use of analgesics/antipyretic/antihistamines/decongestants/ear or nose drops | |
| Prior hearing deficit | |
| Inability to express symptoms | |
| Atopy or allergy | |
| Presence of tube | |
| Parent/caretaker | |
| Parent/caretaker availability | |
| Parent/caretaker preference | |
| Parent/caretaker education | |
| Examiner | |
| Type of examiner (family physician, otolaryngologist, pediatrician, nurse practitioner, physician assistant, etc.) | |
| Skill to diagnose (validated examiner/observer) | |
| Setting (public, private, PPO, HMO, etc.) | |
| Monitoring during episode or course of therapy | |
| When | |
| Frequency (none, daily, every other day) | |
| Primary person (parent or provider) | |
| Type (tympanometry, acoustic reflectometry, pneumatic otoscopy) | |
| Cost | |
| Cost of treatment |
Acute otitis media is defined as 1) presence of middle ear effusion as demonstrated by the actual presence of fluid in the middle ear as diagnosed by tympanocentesis or the physical presence of liquid in the external ear canal as a result of tympanic membrane perforation or indicated by limited or absent mobility of the tympanic membrane, as diagnosed by pneumatic otoscopy, tympanogram, or acoustic reflectometry with or without the following: a) opacification, not including erythema, b) a full or bulging tympanic membrane, or c) hearing loss AND 2) rapid onset (over the course of 48 hours) or 3) one or more of the following signs or symptoms: 1) otalgia (or pulling of ear in an infant), b) otorrhea, c) irritability in the infant or toddler, d) fever with or without anorexia, nausea or vomiting. (Rapid onset is defined as less-than or equal to 48 hours from the onset of acute signs or symptoms first noted by the parent or guardian to contact with the health system.) Uncomplicated AOM is defined as AOM limited to the middle ear cleft.
Observational treatment or no intervention is defined as initial management of the disease WITHOUT any active intervention (pharmacologic or surgical) other than topical or systemic medications (that do not contain antibiotics) given for symptomatic relief (e.g., analgesics, antipyretics, antihistamines, decongestants, ear or nose drops), with or without a monitoring protocol. Placebo treatment is defined as initial management of the disease with a placebo in place of antibiotics in randomized controlled trials. Natural history is defined as the natural course of the disease without any intervention by provider or parent.
For Question 3 all antibiotic regimens are aggregated, and for Question 4 the antibiotic regimens are specified as per the subquestions.
An influencing factor is defined as a characteristic of the patient or the environment or the health care delivery system that may affect the natural history of the disease or the outcome(s) of the intervention of interest.
The otitis-prone child is defined as the child who has had three or more episodes of AOM in a 6-month period or four or more episodes of acute otitis media in a 12-month period. The episodes of AOM should be well-documented. Each episode of AOM should preferably have been separated by at least 4 weeks from the previous episode of AOM and treatment course or documented on followup to have cleared.
| Outcome Measures6: | Time at which outcomes are measured | ||||
|---|---|---|---|---|---|
| <48hrs | 3-7d | 7-14 d | 14d-3m | >3m | |
| Presence/absence of | |||||
| pain | x | x | x | x | x |
| otorrhea | x | x | x | x | x |
| irritability | x | x | x | x | x |
| fever | x | x | x | x | x |
| anorexia | x | x | x | x | x |
| nausea (disequilibrium) | x | x | x | x | x |
| vomiting | x | x | x | x | x |
| diarrhea | x | x | x | x | x |
| Presence/absence of | |||||
| limited or absent mobility of TM | x | x | x | x | x |
| hearing deficit | x | x | x | x | |
| speech problem | x | ||||
| Presence/absence of | |||||
| recurrence of AOM | x | x | |||
| Presence/absence of | |||||
| acute suppurative complication/ | |||||
| secondary complications | |||||
| mastoiditis | x | x | x | x | x |
| petrositis | x | x | x | x | x |
| acute suppurative labyrinthitis | x | x | x | x | x |
| extradural abscess | x | x | x | x | x |
| subdural abscess (empyema) | x | x | x | x | x |
| brain abscess | x | x | x | x | x |
| lateral sinus thrombosis | x | x | x | x | x |
| Presence/absence of | |||||
| side/adverse effects from meds | x | x | x | x | x |
| Presence/absence of | |||||
| bacteria(sterile/nonsterile) | x | x | x | x | x |
| resistant bacteria | x | x | x | x | x |
| Cost of care | |||||
| direct cost | x | x | x | x | x |
| indirect cost | x | x | x | x | x |
| total cost | x | x | x | x | x |
| Quality of life | x | x | x | x | x |
The outcome measures listed here define the scope of the project. The time point at which each outcome measure is considered relevant is marked by "x." This outcome-time matrix will be used as a guide for our evidence analysis in the context of the key questions.
| Time Period: | 1966- 1999 for database searches |
| Literature Source: | MEDLINE |
| EMBASE | |
| HealthSTAR | |
| CINAHL (nursing and allied paramedical professionals) | |
| BIOSIS | |
| Cochrane Library | |
| International Pharmaceutical Abstracts | |
| References of published articles | |
| Language: | English and foreign languages |
| Study Design: | Randomized controlled trials, blinded and unblinded |
| Nonrandomized controlled trials, blinded and unblinded | |
| Prospective cohort studies (for observation/no treatment) | |
| Retrospective cohort studies (for observation/no treatment) | |
| Case-control studies |
Reviewer ID (1=GT, 2=LW) ___
Record #:
Unique Identifier:
Author(s):
Year of Publication
Revisit Search Rejection Criteria
GO IN ORDER FROM R1 TO R5,
STOP AT FIRST "YES"
| Yes | No | Unsure | |
| R1: Case report/editorial/letter/clinical practice/overview/...... Practice guidelines/consensus statements | 1 | 2 | 9 |
| R2: Non-human subjects........................................................ | 1 | 2 | 9 |
| R3: Study condition is NOT acute otitis media...................... | 1 | 2 | 9 |
| R4: Age of study population < 4 weeks or >=18 years | 1 | 2 | 9 |
| R5: Study population on patients with immunodeficiencies or Craniofacial deficiencies including cleft palate | 1 | 2 | 9 |
Key Question Addressed
| Yes | No | Unsure | |
| Natural history.................................................................. | 1 | 2 | 9 |
| Antibiotic vs Observation................................................ | 1 | 2 | 9 |
| Antibiotic vs Placebo........................................................ | 1 | 2 | 9 |
| Antibiotic vs Antibiotic........................................................ | 1 | 2 | 9 |
For each title/abstract, go in order of the five rejection criteria, from R1 to R5. Stop at the first "Yes" in item 6.
If the article is not rejected by R1 through R5, go on to item 7. If item 7 has ALL "No"s, the article will be rejected.
Specific instruction on R1:
Case report includes case series
Overview includes reviews
Specific instruction on AOM:
Reject if the study is solely on: (compiled from Bluestone and Klein, 1996; Otitis Media with Effusion Guidelines, 1994; Harkness and Topham, 1998; and Paparella, Bluestone, et al., 1985)
Otitis media with effusion including the
following synonyms:
Serous
otitis media or serotympanum or acute
serous otitis media or chronic serous
otitis media
Secretory otitis
media
Allergic otitis
media
Catarrhal otitis media or
catarrh
Nonsuppurative otitis
media or chronic nonsuppurative otitis
media
Mucoid otitis media or
mucotympanum or chronic mucoid otitis
media
Secondary otitis
media
Tubotympanic
catarrh
Hydrotubotympanum
Exudative
catarrh
Tubotympanitis
Tympanic hydrops
Glue
ear
Fluid ear
Other chronic or persistent forms of
otitis media:
Chronic otitis
media
Chronic tubotympanic
suppurative otitis media
Chronic atticoantral suppurative otitis
media
Chronic suppurative
otitis media
Chronic purulent
otitis media
Persistent otitis
media
Reject if the PRIMARY condition of the article is not AOM.
Do not reject if the diagnostic term is vague, such as otitis media without any descriptors, or a term with which we are not familiar.
Do not reject if AOM is one of several conditions
studied.
Synonyms for acute otitis media
include: (Bluestone and Klein, 1996)
Acute suppurative otitis media
Acute
purulent otitis media
Bacterial otitis
media
Specific instructions on AGE:
Do not reject if the term "neonate" is used without reference to a specific age range that is completely outside of our scope of greater-than 4 weeks and less-than 18 years.
Reject if the population is referred to as an adult population even if a specific age is not mentioned.
Do not reject if the age scope of the study is a subset of the acceptable age range or has an age range larger than our acceptable age range.
Specific instruction on Natural History:
Criteria for Natural History:
Must address
outcome and
time and
without any intervention
If a study involves other interventions besides antibiotics, such as myringotomy/tympanocentesis, but has a control arm that uses placebo or no intervention, then it qualifies for a Natural History study.
Specific instruction on Type of Antibiotics:
The following antibiotics are included:
Amoxicillin
Amoxicillin-clavulanate
Azithromycin
Cefdinir
Cefixime/Cefprozil
Cefpodoxime
Ceftibuten
Ceftriaxone
Cefuroxime
Clarithromycin
Clindamycin
Loracarbef
Sulfisoxazole
Trimethoprim-sulfamethoxazole
Include all studies on antibiotics, antimicrobials, anti-bacterials, anti-infectives.
If uncertain, do not reject study.
Reviewer ID (1=GT, 2=WM) ___ 1/
Record Number ___ ___ ___ ___ 2-5/
Unique Identifier ___ ___ ___ ___ ___ ___ ___ ___ 6-13/
Authors:
Year of Publication ___ ___ ___ ___ 14-17/
Study Design
| Randomized controlled trial........................................................ | 1 18/ |
| Non-randomized controlled trial.................................................... | 2 |
| Prospective comparative cohorts................................................ | 3 |
| Retrospective comparative cohorts............................................. | 4 |
| Case control.............................................................................. | 5 |
| Natural history/Observational/Longitudinal single cohort............ | 6 |
| Unsure......................................................................................... | 9 |
Key Question Addressed
| Yes | No | Unsure | |||
| Natural history.................................................. | 1 | 2 | 9 | 19/ | |
| Antibiotic vs. Observation.................................. | 1 | 2 | 9 | 20/ | |
| Antibiotic vs. Placebo......................................... | 1 | 2 | 9 | 21/ | |
| Antibiotic vs. Antibiotic | |||||
| a) | antibiotics of broader coverage vs. amoxicillin or trimethoprim/sulfamethoxazole | 1 | 2 | 9 | 22/ |
| b) | oral fluoroquinolones.................................. | 1 | 2 | 9 | 23/ |
| c) | high-dose amoxicillin or amoxicillin-clavulanate vs. standard dose.................. | 1 | 2 | 9 | 24/ |
| d) | twice a day high-dose amoxicillin therapy vs. three time a day amoxicillin.............. | 1 | 2 | 9 | 25/ |
| e) | short- vs. long-term antibiotic therapy.... | 1 | 2 | 9 | 26/ |
| f) | other........................................................... | 1 | 2 | 9 | 27/ |
Check all criteria used in defining acute otitis media:
| Yes | No | Unsure | |||
| a) | presence of fluid in the middle ear on tympanocentesis....... | 1 | 2 | 9 | 28/ |
| b) | limited/absent mobility of TM on pneumatic otoscopy......... | 1 | 2 | 9 | 29/ |
| c) | limited/absent mobility of TM on tympanogram................. | 1 | 2 | 9 | 30/ |
| d) | limited/absent mobility of TM on acoustic reflectometry... | 1 | 2 | 9 | 31/ |
| e) | opacification, not including erythema................................ | 1 | 2 | 9 | 32/ |
| f) | a full or bulging tympanic membrane................................ | 1 | 2 | 9 | 33/ |
| g) | hearing loss..................................................................... | 1 | 2 | 9 | 34/ |
| h) | rapid onset (within 48 hours)........................................... | 1 | 2 | 9 | 35/ |
| i) | otalgia (or pulling of ear in an infant).............................. | 1 | 2 | 9 | 36/ |
| j) | otorrhea........................................................................... | 1 | 2 | 9 | 37/ |
| k) | irritability....................................................................... | 1 | 2 | 9 | 38/ |
| m) | fever............................................................................. | 1 | 2 | 9 | 39/ |
| n) | anorexia............................................................................ | 1 | 2 | 9 | 40/ |
| o) | nausea............................................................................... | 1 | 2 | 9 | 41/ |
| p) | vomiting............................................................................ | 1 | 2 | 9 | 42/ |
| q) | diarrhea................................................................. | 1 | 2 | 9 | 43/ |
| r) | _________________________________________________ | 1 | 44/ | ||
| _________________________________________________ | |||||
| s) | _________________________________________________ | 1 | 45/ | ||
| _________________________________________________ | |||||
| t) | _________________________________________________ | 1 | 46/ | ||
| _________________________________________________ | |||||
| u) | _________________________________________________ | 1 | 47/ | ||
| _________________________________________________ | |||||
| v) | _________________________________________________ | 1 | 48/ | ||
| _________________________________________________ | |||||
| w) | _________________________________________________ | 1 | 49/ | ||
| _________________________________________________ | |||||
| x) | _________________________________________________ | 1 | 50/ | ||
| _________________________________________________ | |||||
| y) | _________________________________________________ | 1 | 51/ | ||
| _________________________________________________ | |||||
| z) | _________________________________________________ | 1 | 52/ | ||
| _________________________________________________ | |||||
| Yes | No | Unsure | |||
| 9. | Was the study described as randomized? | 1 | 0 | 53/ | |
| 10. | Was the study described as double-blind? | 1 | 0 | 54/ | |
| 11. | Was there a description of withdrawals and dropouts? | 1 | 0 | 55/ | |
| 12. | Was randomization procedure appropriate? | 1 | −1 | 0 | 56/ |
| 13. | Was blinding procedure appropriate? | 1 | −1 | 0 | 57/ |
| 14. | Were the groups (exposed or unexposed) similar at baseline regarding the most important prognostic variables? | 1 | 0 | 0 | 58/ |
| 15. | Was compliance with treatment addressed adequately? | 1 | 0 | 0 | 59/ |
| 16. | Was complete followup achieved? | 1 | 0 | 0 | 60/ |
| Yes | No/Unsure | |||
| 17. | Was the study cohort(s) clearly defined? (Inclusion and exclusion criteria clearly spelled out) | 1 | 0 | 61/ |
| 18. | Was the study cohort(s) assembled at an early and uniform point (inception) in the course of the illness? | 1 | 0 | 62/ |
| 19. | Was the pathway(s) by which patients entered the study clearly described? | 1 | 0 | 63/ |
| 20. | Was complete followup achieved? | 1 | 0 | 64/ |
| 21. | Was there a description of withdrawals and dropouts? | 1 | 0 | 65/ |
| 22. | Were objective outcome criteria developed and used? | 1 | 0 | 66/ |
| 23. | Was the outcome assessment "blind?" | 1 | 0 | 67/ |
| 24. | Was adjustment for extraneous prognostic factors carried out? | 1 | 0 | 68/ |
| Yes | No/Unsure | |||
| 25. | Was the source of cases identified? | 1 | 0 | 69/ |
| 26. | Was the source of controls identified? | 1 | 0 | 70/ |
| 27. | Was there blinded assessment of | |||
| a) eligibility of cases and controls | 1 | 0 | 71/ | |
| b) outcome | 1 | 0 | 72/ | |
| c) exposure | 1 | 0 | 73/ | |
| 28. | Were the matching criteria of cases and controls clearly spelled out? | 1 | 0 | 74/ |
| 29. | Were the criteria defining the cases clearly spelled out? | 1 | 0 | 75/ |
| 30. | Was the exposure status clearly identified? | 1 | 0 | 76/ |
| 31. | Was the duration of exposure defined? | 1 | 0 | 77/ |
| 32. | Was the temporal relation of the exposure to the case event clearly defined? | 1 | 0 | 78/ |
| 33. | Was there an adjustment in the analysis for known confounders not included in matching? | 1 | 0 | 79/ |
| Yes | No/Unsure | |||
| 34. | The study was qualified as a natural history study because | |||
| a) it was designed as a natural history study | 1 | 80/ | ||
| b) it was the control arm of a clinical trial | 2 | |||
| c) it was the control arm of a cohort study | 3 | |||
| d) unsure | 9 | |||
| 35. | Was the outcome(s) of the study clearly defined? | 1 | 0 | 81/ |
| 36. | Was the time point(s) at which the outcome(s) was measured clearly defined? | 1 | 0 | 82/ |
| 37. | Was the cohort of subjects followed without any intervention? | 1 | 0 | 83/ |
| 38. | Was there blinded assessment of the outcomes of the study? | 1 | 0 | 84/ |
| 39. | Were point estimates and measures of variability provided for the main adverse outcome measures? | 1 | 0 | 85/ |
Reviewer ID: self-explanatory
Record number: self-explanatory
Unique identifier: self-explanatory
Authors: self-explanatory
Year of publication: self-explanatory
Study design:
In general, this item is self-explanatory.
Remember that case studies, case series, and cross-sectional studies are not included in this list because they are not eligible for the analysis.
If you think the study may be one of those listed or might have the potential with acquisition of the data and reanalysis, mark "9" and, if you like, write a comment.
Key question addressed:
In general, this item is self-explanatory and has the same instructions as for the titles/abstracts screening form.
A particular article may be pertinent to zero or > 1 key question. Circle all that apply.
For 7.a), recall that "antibiotics of broader coverage" may be defined as second-line-or-higher-level treatment.
For 7.e), recall that short-term therapy is < 5 days and that long-term therapy is > 5 days.
For 7.f), "other" is any other comparison of antibiotic vs. antibiotic.
Criteria used in defining acute otitis media:
Some studies may not list any criteria; in this case, circle "2" for 8.a)-8.q).
Be sure to list only those criteria actually used by a study to define a case of acute otitis media. Many studies will also note other signs or symptoms but not actually use them to define acute otitis media.
We will have to go back to the articles and make sure we have the logic and wording of the definitions correct for the evidence tables, especially for the "write-in" criteria 8.r)-8.z).
Randomization: A study calls itself randomized.
Double-blind: "A study must be regarded as double blind if the word 'double blind' is used." (Jadad, Moore, Carroll, et al., 1996)
Withdrawals and dropouts: "Participants who were included in the study but did not complete the observation period or who were not included in the analysis must be described. The number and the reasons for withdrawal in each group must be stated. If there were not withdrawals, it should be stated in the article. If there is no statement on withdrawals, this item must be given no points." (Jadad, Moore, Carroll, et al., 1996)
Appropriate randomization:
"A method to generate the sequence of randomization will be regarded as appropriate if it allowed each study participant to have the same chance of receiving each intervention and the investigators could not predict which treatment was next. Methods of allocation using date of birth, date of admission, hospital numbers, or alternation should not be regarded as appropriate." (Jadad, Moore, Carroll, et al., 1996)
"Assign patients to groups in a way that gives each patient an equal chance of falling into one or the other group." (Fletcher, Fletcher, and Wagner, 1982)
Appropriate blinding: "The method will be regarded as appropriate if it is stated that neither the person doing the assessments nor the study participant could identify the intervention being assessed, or if in the absence of such a statement for use of active placebos, identical placebos, or dummies is mentioned." (Jadad, Moore, Carroll, et al., 1996)
Similarity of comparison groups:
In general, this item is self-explanatory.
At minimum, the groups should be comparable with regard to age, especially the proportion less-than two years of age.
Compliance: self-explanatory
Complete follow-up: The outcome is known for each patient. See item 20 on complete follow-up for a cohort study. The same principles apply.
Cohorts defined: self-explanatory
Inception point: self-explanatory
Entry pathway: self-explanatory
Complete follow-up: "All members of the inception cohort should be accounted for at the end of the follow-up period, and their clinical status should be known." (Sackett, Haynes, and Tugwell, 1985)
Withdrawals and dropouts: See item 11.
Objective outcome criteria: self-explanatory
Blind outcome assessment: The investigator assessing the outcome(s) does not know what exposure(s) the patient has experienced.
Adjustment for extraneous prognostic factors: self-explanatory
Source of cases: self-explanatory
Source of controls: self-explanatory
Blind assessment: See item 23.
Matching criteria: self-explanatory
Criteria defining cases and controls: self-explanatory
Exposure status: self-explanatory
Duration of exposure: self-explanatory
Temporal relation of exposure to case event: self-explanatory
Adjustment for confounders: self-explanatory
Qualification for natural history study: self-explanatory
Outcome(s) defined: self-explanatory
Time point(s) of outcome(s): self-explanatory
Absence of intervention: self-explanatory
Blind outcome(s) assessment: See item 23.
Point estimates and variability for outcome(s): self-explanatory
Reviewer ID (1=GT, 2=WM) ___
Record Number ___ ___ ___ ___
Unique Identifier ___ ___ ___ ___ ___ ___ ___ ___
Authors: __________________________________
Year of Publication ___ ___ ___ ___
Describe the Study Groups
| Parameter | Group 1 | Group 2 | Group 3 | Group 4 |
|---|---|---|---|---|
| Name of intervention | _____________ | _____________ | _____________ | ______________ |
| Dosage | _____________ | _____________ | _____________ | ______________ |
| Frequency | _____________ | _____________ | _____________ | ______________ |
| Duration | _____________ | _____________ | _____________ | ______________ |
| Route of administration | _____________ | _____________ | _____________ | ______________ |
| Co-intervention 1 | _____________ | _____________ | _____________ | ______________ |
| Co-intervention 1 | _____________ | _____________ | _____________ | ______________ |
| Co-intervention 1 | _____________ | _____________ | _____________ | ______________ |
| Co-therapies | _____________ | _____________ | _____________ | ______________ |
| Co-therapies | _____________ | _____________ | _____________ | ______________ |
| Co-therapies | _____________ | _____________ | _____________ | ______________ |
| Co-therapies | _____________ | _____________ | _____________ | ______________ |
| N at beginning of study | _____________ | _____________ | _____________ | ______________ |
| N lost to followup | _____________ | _____________ | _____________ | ______________ |
| Inception time of subjects | _____________ | _____________ | _____________ | ______________ |
List inclusion criteria
| a)_____________________ | b) ___________________ | c) _____________________ |
| d)____________________ | e) ____________________ | f)_____________________ |
| g)_____________________ | h)____________________ | i) _____________________ |
| j)_____________________ | k)___________________ | l) _____________________ |
List exclusion criteria
| a) _____________________ | b) ___________________ | c) _____________________ |
| d) ____________________ | e) ____________________ | f)_____________________ |
| g) _____________________ | h) ____________________ | i) _____________________ |
| j) _____________________ | k) ___________________ | l) _____________________ |
Circle the 'x' at which the outcome measure(s) was(were) studied.
| Time at which outcome was measured | |||||
|---|---|---|---|---|---|
| Outcomes | <48hrs | 3-7 d | 7-14 d | 14d-3 m | >3 m |
| Presence/absence of | |||||
| Pain | x____ | x____ | x____ | x____ | x____ |
| Otorrhea | x____ | x____ | x____ | x____ | x____ |
| Irritability | x____ | x____ | x____ | x____ | x____ |
| Fever | x____ | x____ | x____ | x____ | x____ |
| Anorexia | x____ | x____ | x____ | x____ | x____ |
| nausea (disequilibrium) | x____ | x____ | x____ | x____ | x____ |
| vomiting | x____ | x____ | x____ | x____ | x____ |
| diarrhea | x____ | x____ | x____ | x____ | x____ |
| Presence/absence of | |||||
| limited or absent mobility of TM | x____ | x____ | x____ | x____ | x____ |
| hearing deficit | x____ | x____ | x____ | x____ | x____ |
| speech problem | x____ | ||||
| Presence/absence of | |||||
| recurrence of AOM | x____ | x____ | |||
| Presence/absence of | |||||
| acute suppurative complication/ | |||||
| secondary complications | |||||
| mastoiditis | x____ | x____ | x____ | x____ | x____ |
| petrositis | x____ | x____ | x____ | x____ | x____ |
| acute suppurative labyrinthitis | x____ | x____ | x____ | x____ | x____ |
| extradural abscess | x____ | x____ | x____ | x____ | x____ |
| subdural abscess (empyema) | x____ | x____ | x____ | x____ | x____ |
| brain abscess | x____ | x____ | x____ | x____ | x____ |
| lateral sinus thrombosis | x____ | x____ | x____ | x____ | x____ |
| Presence/absence of | |||||
| side/adverse effects from meds | x____ | x____ | x____ | x____ | x____ |
| Presence/absence of | |||||
| bacteria (sterile/nonsterile) | x____ | x____ | x____ | x____ | x____ |
| resistant bacteria | x____ | x____ | x____ | x____ | x____ |
| Cost of care | |||||
| direct cost | x____ | x____ | x____ | x____ | x____ |
| indirect cost | x____ | x____ | x____ | x____ | x____ |
| total cost | x____ | x____ | x____ | x____ | x____ |
| Quality of life | x____ | x____ | x____ | x____ | x____ |
Circle the influencing factors studied and write down how measured (categories).
| Demographic | |
| Age of child | x ____________________________________ |
| Gender | x ____________________________________ |
| Ethnicity/race | x ____________________________________ |
| Environmental | |
| Presence of sibling(s) | x ____________________________________ |
| Attendance at day care center | x ____________________________________ |
| Sibling(s) in day care center | x ____________________________________ |
| Feeding mode-bottle vs. breast | x ____________________________________ |
| Pacifier use | x ____________________________________ |
| Tobacco smoke exposure | x ____________________________________ |
| Ear infections in parents/siblings | x ____________________________________ |
| Season of the year | x ____________________________________ |
| Symptoms by history | |
| Otalgia and severity | x ____________________________________ |
| Hearing deficit and severity | x ____________________________________ |
| Signs/physical findings | |
| Pulling of ear in an infant | x ____________________________________ |
| Otorrhea | x ____________________________________ |
| Irritability | x ____________________________________ |
| Fever | x ____________________________________ |
| Hearing loss | x ____________________________________ |
| TM inflammation | x ____________________________________ |
| Retracted TM | x ____________________________________ |
| Purulent otorrhea | x ____________________________________ |
| Middle ear effusion | x ____________________________________ |
| Other clinical factors | |
| Otitis prone | x ____________________________________ |
| Underlying predisposing problem | x ____________________________________ |
| Prior antibiotic use & when used | x ____________________________________ |
| Concurrent use of analgesics, etc. | x ____________________________________ |
| Prior hearing deficit | x ____________________________________ |
| Inability to express symptoms | x ____________________________________ |
| Atopy or allergy | x ____________________________________ |
| Presence of tube | x ____________________________________ |
| Parent/caretaker | |
| Parent/caretaker availability | x ____________________________________ |
| Parent/caretaker preference | x ____________________________________ |
| Parent/caretaker education | x ____________________________________ |
| Examiner | |
| Type of examiner | x ____________________________________ |
| Skill to diagnose (validated) | x ____________________________________ |
| Setting | x ____________________________________ |
| Monitoring during episode/therapy course | |
| When | x ____________________________________ |
| x ____________________________________ | |
| Primary person (parent/provider) | x ____________________________________ |
| Type | x ____________________________________ |
| Cost | |
| Cost of treatment | x ____________________________________ |
| ___________________________________ | x ____________________________________ |
| ___________________________________ | x ____________________________________ |
| ___________________________________ | x ____________________________________ |
| ___________________________________ | x ____________________________________ |
| ___________________________________ | x ____________________________________ |
| ___________________________________ | x ____________________________________ |
| ___________________________________ | x ____________________________________ |
For each outcome at each time point and for each age group, influencing factor group, intervention group, provide the following:
| Study Group | Age Gp Studied | Factor 1 Subgroup | Factor 2 Subgroup | Factor 3 Subgroup | Outcome | Begin Time | End Time | N in Group | N had Event |
|---|---|---|---|---|---|---|---|---|---|
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
| ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ | ________ |
Was there multivariate analysis performed?
| Yes | No | Unsure |
| 1 | 0 | 0 |
Type of analysis: _____________________________________
Dependent variable(s):
_____________________________________
_____________________________________
_____________________________________
Independent
variables: _____________________________________
_____________________________________
_____________________________________
_____________________________________
_____________________________________
_____________________________________
Equations/Numerical Results:
___________________________________________________________________
___________________________________________________________________
___________________________________________________________________
___________________________________________________________________
__________________________________________________________