NCBI » Bookshelf » Health Services/Technology Assessment Text (HSTAT) » AHRQ Evidence Reports » Rehabilitation for Traumatic Brain Injury: Evidence Report/Technology Assessment Number 2
 
hserta
AHRQ Evidence Reports
public health

Chapter  2:  Rehabilitation for Traumatic Brain Injury: Evidence Report/Technology Assessment Number 2

A1280

THIS EVIDENCE REPORT IS OUTDATED AND IS NO LONGER VIEWED AS GUIDANCE FOR CURRENT MEDICAL PRACTICE. IT IS MAINTAINED FOR ARCHIVAL PURPOSES ONLY.

Prepared for:
Agency for Health Care Policy and Research

Department of Health and Human Services
U.S. Public Health Service
2101 East Jefferson Street
Rockville, MD 20852
http://www.ahcpr.gov

Contract No. 290-97-0018

Prepared by:
Oregon Health Sciences University, Portland, OR
Randall M. Chesnut, MD
Principal Investigator
Nancy Carney, PhD
Hugo Maynard, PhD
Patricia Patterson, PhD
N. Clay Mann, PhD
Mark Helfand, MD, EPC Director

AHCPR Publication No. 99-E006

February 1999

THIS EVIDENCE REPORT IS OUTDATED AND IS NO LONGER VIEWED AS GUIDANCE FOR CURRENT MEDICAL PRACTICE. IT IS MAINTAINED FOR ARCHIVAL PURPOSES ONLY.

Prepared for:
Agency for Health Care Policy and Research

Department of Health and Human Services
U.S. Public Health Service
2101 East Jefferson Street
Rockville, MD 20852
http://www.ahcpr.gov

Contract No. 290-97-0018

Prepared by:
Oregon Health Sciences University, Portland, OR
Randall M. Chesnut, MD
Principal Investigator
Nancy Carney, PhD
Hugo Maynard, PhD
Patricia Patterson, PhD
N. Clay Mann, PhD
Mark Helfand, MD, EPC Director

AHCPR Publication No. 99-E006

February 1999

Acknowledgments

The authors thank the members of the Brain Injury Support Group of Portland for their support and the use of their library. They also thank the Portland State University Capstone students who volunteered their time to help with the project: Heather Brooks, Samantha Cohen, Justin Davis, Cynthia Davis-O'Reilly, Julie Geil, Cheryl Matsumura, and Jeana Schoonover.

The American Academy of Family Practice provided the model, its Clinical Policy Review Form, on which the authors based their review form for this report.

Preface

The Agency for Health Care Policy and Research (AHCPR), through its Evidence-based Practice Centers (EPCs), sponsors the development of evidence reports and technology assessments to assist public- and private-sector organizations in their efforts to improve the quality of health care in the United States. The reports and assessments provide organizations with comprehensive, science-based information on common, costly medical conditions and new health care technologies. The EPCs systematically review the relevant scientific literature on topics assigned to them by AHCPR and conduct additional analyses when appropriate prior to developing their reports and assessments.

To bring the broadest range of experts into the development of evidence reports and health technology assessments, AHCPR encourages the EPCs to form partnerships and enter into collaborations with other medical and research organizations. The EPCs work with these partner organizations to ensure that the evidence reports and technology assessments they produce will become building blocks for health care quality improvement projects throughout the nation. The reports undergo peer review prior to their release.

AHCPR expects that the EPC evidence reports and technology assessments will inform individual health plans, providers, and purchasers as well as the health care system as a whole by providing important information to help improve health care quality.

We welcome written comments on this evidence report. They may be sent to: Director, Center for Practice and Technology Assessment, Agency for Health Care Policy and Research, 6010 Executive Blvd., Suite 300, Rockville, MD 20852.

Douglas B. Kamerow, M.D. Director, Center for Practice and Technology Assessment Administrator Agency for Health Care Policy and ResearchJohn M. Eisenberg, M.D. Administrator Agency for Health Care Policy and Research

The authors of this report are responsible for its content. Statements in the report should not be construed as endorsement by the Agency for Health Care Policy and Research or the U.S. Department of Health and Human Services of a particular drug, device, test, treatment, or other clinical service.

Structured Abstract

Objective. To examine the evidence for effectiveness of rehabilitation methods at various phases in the course of recovery from traumatic brain injury (TBI) in adults. Specifically, we addressed five questions about the effectiveness of (1) early rehabilitation in the acute care setting, (2) intensity of acute inpatient rehabilitation, (3) cognitive rehabilitation, (4) supported employment, and (5) care coordination (case management).

Search Strategy. A MEDLINE search (1976 to 1997), supplemented by searches of HealthSTAR (1995 to 1997), CINAHL (1982 to 1997), PsycINFO (1984 to 1997), and reference lists of key articles.

Selection Criteria. Broad inclusion criteria were defined for screening eligible abstracts. Two reviewers read each abstract to determine its eligibility. Full articles were included if they met methodologic criteria and were relevant to one of the causal links identified for each major question. Specifically, we included all comparative (controlled) studies, as well as uncontrolled series that had information about the short- or long-term outcomes associated with rehabilitation for traumatic brain injury.

Data Collection and Analysis. We developed an instrument to record data abstracted from each eligible article. The instrument includes items for patient characteristics, interventions, co-interventions, outcomes, study methods, relevance to the specific research questions, and results of the study. We used a three-level system to rate individual studies. Well-designed randomized controlled trials (RCTs) were rated as Class I. RCTs with design flaws, well-done, prospective, quasiexperimental or longitudinal studies, and case-control studies were rated as Class II. Case reports, uncontrolled case series, and expert or consensus opinion were generally rated Class III. Comparative studies that met inclusion criteria were critically appraised and summarized in evidence tables.

Main Results. A total of 3,098 references were specified for inclusion. After removal of duplicates, 569 applied to questions 1 and 2, 600 applied to question 3, 392 applied to question 4, and 975 applied to question 5. Eighty-seven articles pertaining to questions 1 and 2, 114 articles for question 3, 93 articles for question 4, and 69 articles for question 5 passed the eligibility screen. Sixty-seven additional articles were recommended for inclusion by experts or were obtained from reference lists of review articles. There was weak evidence from Class III studies that early rehabilitation during the acute admission reduces the rehabilitation length of stay. Studies of the intensity of acute inpatient rehabilitation had inconsistent results and used study designs that, despite appropriate use of statistical methods to adjust for severity, had serious limitations because of confounders. Controlled trials of cognitive rehabilitation had mixed results, with the strongest evidence (Class I) supporting the use of prosthetic aids to memory. Well-done, prospective observational studies (Class II) support the use of supported employment within the context of well-designed, well-coordinated programs. From one Class II clinical trial, there was no support for case management, but two well-done Class III studies support the use of case management to produce functional improvements.

Conclusions. Population-based studies are needed to examine the overall impact of TBI and the differences in outcomes associated with different rehabilitation strategies. Future studies of cognitive rehabilitation and case management should focus on health outcomes of importance to people with TBI and their families.

This document is in the public domain and may be used and reprinted without permission.

Suggested Citation:

Chesnut RM, Carney N, Maynard H, et al. Rehabilitation for traumatic brain injury. Evidence report no. 2 (Contract 290-97-0018 to Oregon Health Sciences University). Rockville, MD: Agency for Health Care Policy and Research. February 1999.

Summary

Background

Advances in medical technology and improvements in regional trauma services have increased the number of survivors of traumatic brain injury (TBI), producing the social consequences and medical challenges of a growing pool of people with disabilities. Wider awareness of the scope of the problem and its consequences for society has led to rapid growth in the rehabilitation industry. Because of this growth and particularly because clinical rehabilitation strategies vary widely, many groups are interested in the effectiveness of rehabilitation for TBI.

To address this need to identify and assess evidence on TBI rehabilitation, the Agency for Health Care Policy and Research awarded a contract to Oregon Health Sciences University for a review of published reports and compilation of an evidence report. This summary highlights information presented in the full report.

Impact of Traumatic Brain Injury

Injury is the leading cause of mortality among Americans under 45 years of age; TBI is responsible for the majority of these deaths. An estimated 56,000 lives are lost in the United States each year to TBI. Motor vehicle accidents, followed by gunshot injuries and falls, are the leading causes of injuries resulting in death from TBI. Males are 3.4 times as likely as females to die of TBI. About 50 percent of people who sustain TBI are intoxicated at the time of injury.

In a recent analysis based on hospital discharge data and vital statistics, the annual incidence of TBI in the United States was estimated to be 102.8 per 100,000. In males, the incidence peaks between the ages of 15 and 24 (248.3 per 100,000) and again above 75 years of age (243.4 per 100,000). The incidence in females peaks in the same age groups, but the absolute rates are lower (101.6 and 154.9, respectively). These rates underestimate the true incidence of head trauma because patients with milder symptoms at the time of injury usually are not hospitalized.

About three-quarters of traumatic brain injuries that require hospitalization are nonfatal. Each year, about 80,000 survivors of TBI will incur some disability or require increased medical care. Direct medical costs for TBI treatment have been estimated at $48.3 billion per year, including the costs of hospitalization for acute care and various rehabilitation services. In the years 1988 to 1992, reports of average length of stay (LOS) for the initial admission for inpatient rehabilitation range from 40 to 165 days. In one multicenter study (the Model Systems study), the average rehabilitation LOS was 61 days, and the average charge was $64,648 exclusive of physician fees. Total charges averaged $154,256. In more recent studies performed in the early 1990s, rehabilitation LOS and charges were lower, ranging from 19 days and $24,000 for patients with milder injuries to 27 days and $38,000 for those with severe injuries. In the Medicare population in 1994, mean charges for patients admitted for brain injury (excluding stroke) were $42,056.

To focus attention on important questions, the life of an adult survivor of TBI was characterized by the developers of the report in terms of five phases. The first phase is pre-injury. Medical treatment is divided into two phases: the acute (or immediate) treatment phase and the intensive treatment phase, lasting days to weeks. The rehabilitation phase may last months to years. The survivor phase implies the remaining life of the person with TBI and involves continual development and adjustment. This division into phases clarifies the three challenges to assessing the efficacy of rehabilitation discussed above. For each phase, patient populations, interventions, and outcome measures were identified, and the literature was reviewed to answer key questions identified by technical experts.

Key Questions About Traumatic Brain Injury

The following three questions about the status of brain injury research underlie uncertainty about the effectiveness of rehabilitation services.

  • 1

    How should fundamental concepts such as recovery, functional status, and disability be defined? Because brain function is highly complex, TBI has an extremely wide range of potential outcomes, including cognitive deficits, motor disabilities, emotional and social dysfunction, personality changes, and changes in appearance. As a result, therapeutic aims and perspectives vary widely among studies, as do definitions of outcomes, making valid comparisons across studies difficult.

  • 2

    How should the type and severity of the injury itself be measured? Variations in methods to assess the severity of injury in patients entering rehabilitation make it difficult to estimate the effectiveness of different rehabilitation methods.

  • 3

    Which therapies are effective, and what is the best way to match patients with treatment approaches likely to be effective for them?

Today, a person's path to rehabilitation after sustaining brain injury may be determined by the mechanism of injury, the resources of the community, the person's employment or financial status, the consent of the family, and/or the accuracy of the emergency department diagnosis. While a few metropolitan areas have organized referral systems that connect patients with resources and rehabilitation programs, systematic methods for evaluating the needs of people who have sustained brain injury and referring them to appropriate programs are unusual. Without knowing the efficacy of rehabilitation methods in their specific applications, systematic referral that produces the desired result is not possible.

Reporting the Evidence

Two panels of experts worked with the research team to identify key questions in the rehabilitation and survivor phases for adults with TBI. The first panel was composed of two physiatrists, a survivor of TBI, the wife of a survivor of TBI, a State vocational rehabilitation counselor, a neuropsychologist, a psychologist, a clinical coordinator of an outpatient TBI rehabilitation program, and a rehabilitation clinical nurse specialist, all from the Portland, OR, area. The second panel was composed of nationally recognized experts in rehabilitation.

The panels formulated five questions pertaining to the phases of recovery described above. These questions addressed the effectiveness of (1) early rehabilitation in the acute care setting (timing), (2) intensity of rehabilitation, (3) cognitive rehabilitation, (4) supported employment, and (5) care coordination (case management). For each of these questions, members of the research team worked with panelists to write a brief rationale for the question, define key terms, and specify the relevant patient populations, interventions, and outcome measures to be examined in the literature review. The questions were:

  • Should interdisciplinary rehabilitation begin during the acute hospitalization for traumatic brain injury?

  • Does the intensity of inpatient interdisciplinary rehabilitation affect long-term outcomes?

  • Does the application of cognitive rehabilitation enhance outcomes for people who sustain TBI?

  • Does the application of supported employment enhance outcomes for people with TBI?

  • Does the provision of long-term care coordination enhance the general functional status of people with TBI?

Methodology

A MEDLINE search (1976 to 1997), supplemented by searches of HealthSTAR (1995 to 1997), CINAHL (1982 to 1997), and PsycINFO (1984 to 1997), produced a total of 3,098 references to be considered for inclusion; of these, 569 applied to questions 1 and 2, 600 applied to question 3, 392 applied to question 4, and 975 applied to question 5.

Abstracts of each article retrieved by these searches were reviewed independently by two members of the research team, who applied predefined, broad eligibility criteria. When the two reviewers disagreed, a third reviewer read the abstract and cast the deciding vote on whether it should be included. In the event a reference did not have an abstract, and the title for the reference was not sufficient for determination of status, the article was retrieved and reviewed to determine its eligibility. The two reviewers examined each abstract and indicated whether it met the inclusion criteria and, if not, the reason for exclusion. If the abstract was eligible, or if it did not contain sufficient information to determine eligibility, the full text of the article was retrieved for review in the next phase of the selection process.

Eighty-seven articles pertaining to questions 1 and 2, 114 articles for question 3, 93 articles for question 4, and 69 articles for question 5 passed the eligibility screen. Sixty-seven additional articles were recommended for inclusion by experts or by review of reference lists of review articles. In all, 363 articles were retrieved for review and abstraction.

Additional criteria for inclusion were defined separately for each of the five questions. The criteria varied because the necessary types of studies varied from question to question. Articles that applied to more than one question were maintained as duplicates (or triplicates, etc.) in each question-specific file, so they could be considered for inclusion based on their relevance to each question.

Data Abstraction

An instrument was designed to record data abstracted from each eligible article. The instrument includes items for patient characteristics, interventions, cointerventions, outcomes, study methods, relevance to the specific research questions, and results of the study. The instrument has two components: the first three pages of the instrument apply to all articles specified for inclusion in the study; the remaining pages are individual instruments that apply to one of the five questions. To abstract an article, a reader used the initial abstraction instrument plus one or more of the five question instruments.

The first few questions of the initial abstraction instrument allowed the reviewer to determine if the article actually met the eligibility criteria for inclusion in the report. If an article was determined to be ineligible, it was passed to a second reader for confirmation. The remaining articles were subjected to the full abstraction protocol.

Specification of Level of Evidence

A three-level system was used to rate individual studies. Well-designed randomized controlled trials (RCTs) were rated as Class I. Studies rated as Class II were RCTs with design flaws; well-done, prospective, quasiexperimental or longitudinal studies; and case-control studies. Case reports, uncontrolled case series, and expert or consensus opinion were generally rated Class III. A well-done, prospective, multicenter or population-based case series can provide valuable information that, in some ways, is more reliable than data from a randomized trial done in a highly selected sample of patients. However, when used to make inferences about effectiveness, an uncontrolled case series is generally classified as Class III, indicating the lowest level of confidence.

A "gray zone" exists between Class II and definite Class III articles. Much of the research in rehabilitation uses quasiexperimental designs. In these observational study designs, control subjects are sometimes identified from a separate patient population. For instance, one group of researchers compared patients undergoing inpatient rehabilitation to a sample of people with TBI who had been treated in a region of the country where formal inpatient TBI rehabilitation was not available. This was an entirely separate patient group, and all the data except outcome measures came from an independent database.

The main difficulty with the quasi-experimental design is lack of control over the constitution of the compared groups. Because there is no randomization and generally no control over the details of the selection process through which the patients received their separate therapies, the groups are likely to differ in the frequency of characteristics that are associated with the outcomes of interest. Even when significant efforts are made to match the experimental and the quasi-control groups, it is likely that significant differences between the groups will remain.

Much of the literature relevant to the five questions addressed in this effort falls into the "gray zone" between Class II and Class III. For this reason, critical appraisal of key studies played a particularly important role in this review. A number of characteristics of these studies were considered relevant to all rehabilitation questions and were recorded in the data abstraction form. Evaluation of the following factors played a major role in critically appraising these articles:

  • Prospective collection of data.

  • Complete description of parent study population.

  • Large study population (driven by hypothesis, power, type I error threshold).

  • Study setting--a single center, many centers, or population based.

  • Description of reasons for referral to service being studied.

  • Description of methods sufficiently complete to permit study replication.

  • Complete description of rehabilitation technique in question (independent variable).

  • Complete description of differences between "control" and "experimental" groups.

  • Conditions determining whether patients did or did not receive the rehabilitation technique in question.

  • Information about potential confounders, including types and severity of injury, age, and others (including, in some cases, economic status, educational level, lack of family support).

  • Measurement of confounding variables using instruments validated as accurate, sensitive, and reliable.

  • Payer group.

  • Choice of outcome variables that are meaningful to patients and caregivers.

  • Use of functional status and other health outcomes rather than surrogate (intermediate) outcomes.

  • Measurement of outcome variables using instruments validated as accurate, sensitive, and reliable.

  • Timing of outcome measurements.

  • Assessment of patient characteristics and outcomes by blinded observer.

  • Use of multivariate statistical analysis: Were interactions sought and controlled for? Were risk estimates calibrated? Were all relevant confounders included as candidate variables?

The criteria used to classify articles and the features to be considered in critically appraising them were discussed at the subcommittee, committee, national expert panel, and Aspen Neurobehavioral Conference levels with the goal of maintaining consensus at least on the relative stratification of individual articles.

Construction of Evidence Tables

Evidence tables were constructed to summarize the best evidence about effectiveness pertaining to each question. No randomized trials and only a few quasiexperimental studies were available for questions 1 and 2. There were a large number of relevant observational studies of important relationships (for example, the relation of patient characteristics to outcome); studies that concerned individual causal links or relationships in evidence tables were not summarized. For question 3, addressing cognitive rehabilitation, 15 randomized controlled trials and comparative studies that met specified inclusion criteria were placed into evidence tables. All comparative studies located for the last two questions, which addressed supported employment and care coordination, were included in evidence tables.

Critical Appraisal of Key Articles

For each of the five questions, subcommittees were formed consisting of one or two members of the research team and one or two members of the local technical panel. Each subcommittee was chaired by a member of the research team. Key articles relevant to the assigned question were reviewed in depth by all members of the subcommittees. These reviews were discussed among the various members of the subcommittees, and the results were summarized by the chair. This was an effort to ensure that the summary statements on the research questions reflected the expertise and experience of a variety of technical experts with relevant skills and training. These interpretive efforts addressed the methods and results of individual studies, their rating, and their scientific importance.

All of the critical articles for the five questions were individually read by the principal investigator. Summaries were presented and discussed with national experts at the Aspen Neurobehavioral Conference in April 1998.

Findings

Question 1

One small, retrospective, observational study from a single rehabilitation facility supports an association between the acute institution of formalized, multidisciplinary, physiatrist-driven TBI rehabilitation and decreased length of stay (acute hospital and acute rehabilitation) and some measures of short-term physiologic (noncognitive) patient outcomes. The level of evidence is Class III. This study concerned adult patients with severe brain injury (Glasgow Coma Scale 3-8); there is no evidence from comparative studies for or against early rehabilitation in patients with mild and moderate injury.

Question 2

When measured as the hours of application of individual or grouped therapies, there is no indication that the intensity of acute, inpatient TBI rehabilitation is related to outcome. Because of methodological weaknesses, however, previous studies are likely to have missed a significant relationship if one exists (a Type II error). These studies contained insufficient information about severity of injury and baseline function to ensure the comparability of compared groups. Also, these studies did not consider the quality of individual treatments, their lack of autonomy in the cognitive realm, and the delivery milieu. One or more of these factors may affect the outcome of care more than the time spent in each modality. Therefore, future research into efficacy of acute inpatient TBI rehabilitation must more adequately measure such factors and include the factors in their predictive models. Future studies also must employ a wider spectrum of outcome measures, including measurement of outcomes across longer periods of time after discharge.

From a clinical aspect, the evidence does not support equating different TBI rehabilitation delivery systems based on equivalent times of patient exposure to various therapeutic modalities. For example, this analysis would not support predicting that patient benefit would be equal if an equal time spectrum of rehabilitation therapies were delivered at a rehabilitation center as compared with a skilled nursing facility. More detailed analysis of factors involved in predicting response to rehabilitation modalities must be considered in approaching such questions.

Additionally, mandating a minimum number of hours of applied therapy for all TBI patients is not supported by the present state of scientific knowledge. How much of which intervention(s) optimizes recovery in a given type of patient has been inadequately studied. It is certainly reasonable to avoid situations in which patients do not receive potentially beneficial treatment. Based on the above studies, however, defining a minimal rehabilitation program in terms of time of applied therapy is not likely to optimize either the therapists' time or patients' recovery. It is probable that specific basic programs will have to be related to individual patient groups. Developing such algorithms requires further research.

Many patients who suffer TBI do not enter acute inpatient rehabilitation. Only one study of the effectiveness of inpatient rehabilitation included a comparison group of patients who did not undergo inpatient rehabilitation. Future studies should compare acute, inpatient rehabilitation to commonly used alternatives to inpatient rehabilitation, such as care in a well-staffed skilled nursing facility or in less intense variations of acute rehabilitation. Very little is known about the outcomes of TBI in these settings.

Question 3

There is evidence from two small studies (Class I and Class III) that a personally adapted electronic device, a notebook, and an alarm wristwatch reduce everyday memory failures for people with TBI. There is evidence from one study (Class II[a]) that compensatory cognitive rehabilitation (CCR) reduces anxiety and improves self-concept and relationships for people with TBI. Evidence from two studies (Class I and Class II[b]) supports the use of computer-aided cognitive rehabilitation (CACR) to improve immediate recall on neuropsychological testing, but the clinical importance of this finding has not been validated.

Question 4

Class II evidence indicates that supported employment can improve the vocational outcomes of TBI survivors. Nearly all information about supported employment comes from two bodies of work, each of which used different experimental designs and different models of supported employment. The findings have not been replicated in other settings or by other centers, so the generalizability of these programs remains untested.

Question 5

There have been very few studies on the effectiveness of case management, and the results of these studies are mixed. The only outcome for which there were results in the same direction from two or more studies pertained to changes in vocational status. This was associated with the single case-manager and insurance approach, as well as with the combined nurse and vocational case-manager model. There were conflicting results about the effects of case management on disability or functional status, living status, family impact, and other aspects, and some findings were mentioned in only one study. The clinical trial resulted in no functional status changes among case-managed subjects, despite an extended period of rehabilitation. However, when two forms of case management were compared, both the single and multiple case-manager/insurance approaches showed significant functional improvements.

Future Research

The evidence report identifies the following areas for future research.

  • 1

    Randomized trials of the timing and intensity of early and acute rehabilitation would be useful. Because the patient characteristics that affect outcomes also affect the type and level of rehabilitation services delivered, it may be unlikely that any observational study can provide definitive evidence about effectiveness. Moreover, assigning patients to different levels of intensity or to early versus conventional initiation of rehabilitation in a prospective trial may be ethically acceptable, since these different levels represent a range of current practice rather than a deviation from it.

  • 2

    Population-based studies of all patients with TBI, including those who do not enter inpatient rehabilitation facilities, are imperative. Important questions about the effectiveness of rehabilitation and its component disciplines require the development of regional or national registries, with standardized data collection and identification and followup of all patients with head injury.

  • 3

    Research designs for future studies should incorporate health outcomes of importance to people with TBI and their families. Commonly used measures should be more strongly linked to health outcomes. Future studies should address the effect of spontaneous recovery, systematize criteria for entering cognitive rehabilitation, and differentiate between the effects of general stimulation and specific techniques.

  • 4

    The greatest overall need for the evaluation of supported employment programs is a series of trials with adequate controls and unbiased allocation of clients to the conditions compared.

  • 5

    Future research should focus on improving the outcome measures used to examine the results of case management in TBI rehabilitation. In addition to outcomes of changed patient functionality, there should be outcomes of changed family functionality. Since much of case management communication is directed toward helping family members learn what to expect and where to obtain services, relevant outcomes would include family use of community and rehabilitation services and indicators of family assertiveness about care expectations. While case management may exert only an indirect effect on a patient's functional outcomes such as level of disability, vocational status, and living status, it is possible that case management can directly affect family knowledge of TBI rehabilitation needs and services, level of psychosocial anxiety, and family competency in coping with TBI.

Chapter 1. Introduction and Background

An estimated 4.5 million people in the United States are disabled as a result of traumatic brain injury (Centers for Disease Control and Prevention [CDC], 1998). Advances in medical technology and improvements in regional trauma services have increased the number of survivors1 of traumatic brain injury (TBI), producing the social consequences and medical challenges of a growing pool of people with disabilities (Annoni, Beer, and Kesselring, 1992; Ewing, Thomas, Sansces, et al., 1983). Lifelong disability is the consequence for 80,000 to 90,000 individuals each year (CDC, 1998). As a result, answers to questions about recovery are being pursued through a multitude of research projects by various communities with distinct objectives.

Wider awareness of the scope of the problem and its consequences for society has led to rapid growth in the rehabilitation industry. Because of this growth, and particularly because clinical rehabilitation strategies vary widely, many groups are interested in the effectiveness of rehabilitation for TBI.

Rehabilitation experts have recognized the inadequacy of applying traditional models, effective with broken arms or legs, to the task of recovery from brain injury and cerebral tissue damage.

Payers have begun to recognize the inadequacy of current standards for funding rehabilitation from brain injury; they want to know what long-term outpatient programs are most likely to return a person to functional independence; when specific types of rehabilitation should start and when they should end; and which components of complex, multidisciplinary rehabilitation programs are effective.

Congress has raised questions about unmet needs for rehabilitation services, the adequacy of care in existing facilities, and the relative costs and effectiveness of the wide variety of rehabilitation services offered to survivors of TBI.

A strong and growing advocacy movement of survivors of TBI and their families has a research agenda that includes defining recovery and functional status in terms of quality of life as well as financial independence.

Three questions about the status of brain injury research underlie uncertainty about the effectiveness of rehabilitation services. First, how should fundamental concepts such as recovery, functional status, and disability be defined? Because brain function is highly complex, TBI has an extremely wide range of potential outcomes, including, for example, cognitive deficits, motor disabilities, changes in emotional and social function, personality changes, and changes in appearance. As a result, therapeutic aims and perspectives vary widely among studies, as do definitions of outcomes, making valid comparisons across studies difficult.

Second, how should the type and severity of the injury itself be measured? Variation in methods to assess the severity of injury in people entering rehabilitation make it difficult to estimate the effectiveness of different methods of rehabilitation.

Third, which therapies are effective, and how can patients best be matched to treatment approaches likely to be effective for them? Today, a person's path to a rehabilitation program after sustaining brain injury may be determined by the mechanism of injury, the resources of the community, the person's employment or financial status, the consent of the family, and/or the accuracy of emergency department diagnosis. While a few metropolitan areas have organized referral systems that connect people with TBI with resources and rehabilitation programs, systematic methods for evaluating the needs of those who have sustained brain injury and referring them to appropriate programs are unusual. Without knowing the efficacy of rehabilitation methods in their specific applications, systematic referral that produces the desired result is not possible.

Another major theme in the literature and in public discourse concerns the costs associated with traumatic brain injury and the cost-effectiveness of its treatment. The clinical economic problem posed by people with TBI is how much to invest in their rehabilitation after it is clear they will survive their injuries. Our ability to maximize the return on this investment is limited by a lack of accurate information about the costs of TBI and the costs and benefits associated with various treatments.

Given the current interest in the effectiveness of rehabilitation for TBI, the Agency for Health Care Policy and Research (AHCPR) selected this topic as one to be investigated by an Evidence-based Practice Center (EPC). AHCPR selected Oregon Health Sciences University (OHSU) to produce the evidence report. The OHSU EPC found a partner in the planning committee for the Consensus Development Conference on Rehabilitation of Persons with Traumatic Brain Injury, sponsored by the National Institutes of Health and held in October 1998. In addition, the Brain Injury Association, Inc., an organization with a mission to support research leading to better outcomes for people who sustain a brain injury, indicated their willingness to serve as a partner with the OHSU EPC in the development of this evidence report.

In this report, we examine available evidence about the effectiveness of rehabilitation for adult survivors of TBI. Specifically, we report the results of a systematic effort to identify the best available evidence about the various strategies to improve the outcome of traumatic brain injury in the most common rehabilitation settings. The main attribute of a systematic review is the application of methods designed to avoid the biases inherent in less formal approaches to reviewing the literature. For example, to avoid bias in the identification and selection of articles, a systematic review uses predefined search strategies and explicit criteria for inclusion or exclusion of studies. This approach can uncover published evidence that might be ignored in an informal review in which studies that are widely known or that support a particular viewpoint are more likely to be identified. Similarly, a systematic review applies methods to reduce bias in interpreting studies, such as review by more than one investigator and the use of a data abstraction form.

In addition to being systematic, we employed methods to assess the methodologic strength of individual studies and the strength of evidence supporting assertions about the effectiveness of interventions. The strongest evidence for effectiveness comes from experimental studies, in which subjects are randomly assigned to alternative interventions. In many cases, inferences about effectiveness are drawn from the results of uncontrolled, or poorly controlled, cohort studies. In these observational studies, a group of subjects is followed over time. Such studies are particularly useful for describing the incidence of certain outcomes over time and for analyzing the relationship between risk factors and those outcomes. However, observational studies often provide weak or flawed evidence about effectiveness, because it is not clear if the observed outcomes resulted from specific interventions or if they would have occurred anyway in the absence of the intervention.

How should the information in this report be used? Our main goal is to provide a guide to the strengths and limitations of the evidence about these interventions that organizations can use to develop evidence-based practice guidelines and other tools for rehabilitation. Another goal is to identify information gaps and controversies that can be addressed in future research studies. A finding that a particular treatment is proven effective or proven ineffective may dominate a discussion about what should be done. Most findings, however, are in between--i.e., "not proven" rather than "proven not." In these situations, factors other than the strength of evidence should be considered in deciding on a clinical recommendation. Patient and societal preferences and values such as equity, attitudes about risk, and evidence about the relative benefits and harms should be considered in making a recommendation about practice.

The Course and Lifetime Burden of TBI

Incidence and Costs of TBI

TBI is the leading cause of death and disability among children and young adults in the United States (CDC, 1998). An estimated 56,000 lives are lost in the United States each year to TBI (Kraus and McArthur, 1996). Motor vehicle accidents, followed by injuries due to firearms and falls, are the leading causes of death from TBI (Sosin, Sniezek, and Waxweiler, 1995). Males are 3.4 times as likely as females to die of TBI (National Institute of Neurological Disorders and Stroke). About 50 percent of people who sustain TBI are intoxicated at the time of injury (Ruff, Marshall, Klauber, et al., 1990; Kreutzer, Doherty, Harris, et al., 1990).

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3309_f1-1.jpg.

   Figure 1. Incidence of traumatic brain injury per 100,000 U.S. population

Source: MMWR - Morbidity and Mortality Weekly Report. 46(1):8-11, 1997 Jan 10.

In a recent analysis based on hospital discharge data and vital statistics, the annual incidence of TBI in the United States was estimated as 102.8 per 100,000 (CDC, 1997). Figure 1 shows TBI incidence rates by age group and sex. In males, the incidence peaks between the ages of 15 and 24 (248.3 per 100,000) and again above 75 years of age (243.4 per 100,000). The incidence in females peaks in the same age range, but the absolute rates are lower (101.6 and 154.9, respectively). These rates may underestimate the true incidence of head trauma because people with milder symptoms at the time of injury are usually not hospitalized.

Table 1. Direct medical care and rehabilitation costs
Type of costsCost definitions
Direct personal care costsAll additional costs of supported living arrangements required by the person with TBI relative to independent community living.
Direct family out-of-pocket costsCopayments and deductibles for covered health care services, expenses for uncovered health care services, child care expenses while attending rehabilitation, child care costs due to inability of patient to care for child, transportation to/from rehabilitation, cost of home renovation to adapt to the needs of the person with TBI (e.g., wheelchair access, installing a bathroom on a main floor).
Indirect medical care and rehabilitation costsTravel time receiving rehabilitation treatment, waiting time, time spent by caregivers, family members, or friends in providing care.
Lost productivityLost productivity for the person with TBI and caregiver(s) because of the person with TBI.
Friction costsTransaction costs (e.g., hiring, training) associated with replacement of a worker.
InsuranceLoading fees (profit and claims administration costs) for health and liability insurance, increase in experience-rated health insurance premiums for people with TBI subsequent to their injuries.
EducationCosts of formal retraining of workers with TBI into former or new jobs because of their disabilities.
Social welfareAdministrative costs of social welfare system to determine eligibility and set up transfer payments for income maintenance, direct publicly financed treatment (rehabilitation and sheltered living arrangements), and health insurance.
Consumer auto modificationsCosts of modifications to automobiles driven by people with TBI to install adaptive devices to compensate for impairments.
Legal/justice systemCosts of the tort liability system for determining the compensatory damages for TBI resulting from negligence; costs of the tort system for appealing decisions from the social welfare system relating to income maintenance for people with TBI.
Pain, suffering, bereavementBodily pain and unobservable psychological and emotional distress for people with TBI and their families caused by the injury, its treatment, and the associated loss of functioning. Note that these costs are separate from the lost productivity effects associated with chronic pain and emotional distress. Ideally, these effects would be valued by a person's willingness to pay to avoid these TBI symptoms.

Note: Shading in the cells denotes the settings of treatment phase or application of techniques in that phase. Grid shading denotes greater correlation of phase with setting or technique.

About three-quarters of traumatic brain injuries that require hospitalization are nonfatal. Each year, about 80,000 survivors of TBI will incur some disability or require increased medical care (Kraus and Sorenson, 1994). From an economic viewpoint, the problem posed by survivors of TBI is how much to invest in their rehabilitation after it becomes clear they will survive. The type, intensity, and duration of rehabilitation services affect the total economic impact associated with TBI. For example, investing in rehabilitation services to help a survivor become independent or return to work may reduce the lifetime economic burden of illness. To date, no study has comprehensively examined the lifetime costs of TBI. As shown in Table 1, the total economic impact includes many types of costs besides direct medical costs. A starting point for estimating these costs would be information about the prevalence of chronic TBI in the general population, but such data are lacking.

Although it is difficult to precisely quantify costs, useful information can be gleaned by studying charge data from published studies in various settings. The total cost of traumatic brain injuries in the United States is estimated to be $48.3 billion annually. Hospitalization accounts for an estimated $31.7 billion, whereas fatal brain injuries cost the Nation approximately $16.6 billion (Lewin, 1992).

In recent years, LOS and inpatient costs for rehabilitation have decreased. In the years 1988-1992, reports of average LOS for the initial admission for inpatient rehabilitation range from 40 to 165 days (Blackerby, 1990; Carey, Seibert, and Posavac, 1988; Giacino, Kezmarsky, DeLuca, et al., 1991; Mackay, Bernstein, Chapman, et al., 1992; McMordie and Barker, 1988; Rappaport, Herrero-Backe, Rappaport, et al., 1989). In one older multicenter study (the Model Systems study), the average rehabilitation length of stay (LOS) was 61 days, and the average charge was $64,648 exclusive of physician fees. Total charges averaged $154,256 (Lehmkulh, Hall, Mann, et al., 1993). In more recent studies performed in the early 1990s, rehabilitation LOS and charges were lower, ranging from 19 days and $24,000 for patients with milder injuries to 27 days and $38,000 for those with severe injuries (Cowen, Meythaler, DeVivo, et al., 1995). In the Medicare population in 1994, mean charges for patients admitted for brain injury (excluding stroke) were $42,056 (Chan, Koepsell, Deyo, et al., 1997).

Conceptual Model of the Lifetime Burden of Illness

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3309_f1-2.jpg.

   Figure 2. The career of a TBI survivor

To focus attention on important questions, we characterized the life of a person with TBI in terms of five phases, as presented in Figure 2. The first phase is "pre-injury." "Medical treatment" is divided into the acute (or immediate) treatment phase, and the intensive treatment phase, lasting days to weeks. The "rehabilitation" phase may last months to years. The "survivor" phase signifies the remaining life of the person with TBI and involves continual development and adjustment. This division into phases clarifies the three challenges to assessing the efficacy of rehabilitation discussed above. Patient populations are defined generally in terms of the phases, and interventions and outcomes must be specific to the phase being evaluated.

Mechanisms of Brain Injury

In TBI, the disease process begins at the moment of impact and extends thereafter for a protracted period of time. In strictly biological aspects, the brain injury disease process can be divided into primary and secondary insults. The primary insult initiates with the physical trauma to the brain. The secondary insults occur thereafter and, in many cases, are the primary determinants of outcome.

Beginning at impact and continuing for a generally brief period, primary insults to the brain include formation of intracranial hematomas (subdural or epidural), intracerebral hematoma, cerebral parenchymal contusions, cerebral swelling, and/or diffuse axonal injury. Intracranial hematomas such as subdurals and epidurals occur outside of the brain parenchyma and exert much of their pathological effects via increasing pressure on the brain (elevation of intracranial pressure [ICP]). Particularly with respect to epidural hematomas, if this pressure is avoided or rapidly reversed through expedient surgery, there may be no damage to the underlying brain and no residual effects of the hematoma. When there is a period of protracted intracranial hypertension, the ICP elevation may result in herniation of the brain tissue through orifices of the skull and/or cerebral ischemia due to interference with cerebral blood flow. Depending on magnitude and duration, such insults can produce deficits that vary from subtle to mortal.

Subdural hematomas also can cause significant intracranial hypertension and have a high likelihood of damaging underlying brain. This damage is often the primary determinant of long-term recovery.

Similar concerns about ICP are also relevant to cerebral swelling. Intracranial processes such as increased extracellular or intracellular fluid or elevated intracranial blood volume can raise ICP and impair adequate blood flow to the brain. In addition, some of these processes can cause primary cellular damage or ischemia by interfering with oxygen transport between vessels and cells.

Injuries such as intracerebral hematomas and cerebral contusions result in blood intermixed with brain. In the case of contusions, the pathology includes primary damage to neuronal cells. In both instances, the presence of blood within brain tissue appears to have significant toxic effects which can produce profound secondary insults to the injured tissue.

Diffuse axonal injury is a somewhat different disease entity. In this injury type, the physical forces the brain sustains during an injury characteristically consist of linear as well as angular acceleration or deceleration. These forces disrupt axons within the cerebral white matter, and these are called shear injuries. In this injury type, there may be no herniation or intracranial hypertension and, indeed, computer tomographic (CT) studies often may be normal or remarkably benign in appearance. Unfortunately, the widespread damage to the white matter will produce a recovery that is characteristically slow and incomplete.

Primary brain injuries occur at the time of injury and, by definition, must be treated post hoc. Secondary brain injuries are initiated sometime after injury and are often due to systemic factors. Their generally delayed onset allows them to be treated when they occur and also to be forestalled. This aspect of prevention has stimulated many of our trauma protocols and drives significant ongoing pharmaceutical research efforts.

The best known and possibly most devastating secondary brain insult is that of cerebral ischemia due to systemic hypotension. Systemic hypotension is extremely common, occurring in about one-third of patients with TBI during the period of injury through the end of resuscitation. A single hypotensive episode is associated with a doubling of mortality (Chesnut, Marshall, Klauber et al., 1993). Systemic hypotension illustrates the profound influence secondary brain insults can have on recovery and strongly supports the potential benefits of optimal trauma care.

Secondary brain insults may be due to intracranial processes that are initiated by:

  1. Primary brain injury.

  2. Secondary systemic insults such as hypoxia or hypotension.

  3. Injuries to extracranial organ systems.

  4. Systemic complications directly or indirectly related to the initial traumatic incident.

Secondary brain insults arising from the initial trauma include a number of toxic cellular and subcellular biologic processes, including:

  1. Cerebral edema.

  2. Alterations in intracranial ionic homeostasis (e.g., calcium, chloride).

  3. Free radical formation.

  4. Alterations at the molecular biology level.

These processes may result in ongoing and self-perpetuating brain injury. Cerebral edema will interfere with transport of nutrients, oxygen, and waste products and cause injuries to cells surrounding the area of primary injury as well as impair the healing of the initially damaged cells. Alterations in ionic homeostasis will disrupt the transmission properties of the neuronal and neighboring cells. Free radical formation can initiate a self-perpetuating cascade of toxic elements that may damage cells initially untouched by the injury. Finally, alterations at the molecular biology level will interfere with the primary genetic cellular control processes.

Secondary brain insults due to hypoxia or hypotension have become very well recognized over the past two decades and are a primary target of resuscitation protocols. The magnitude of importance of these insults is illustrated by the data on hypotension. Because we now have several tools to effectively recognize and treat such insults that are so devastating, intense interest is currently focused on managing them. Secondary insults also may occur from systemic trauma to extracranial organ systems. Although much of the influence of such extracranial trauma is mediated through hypoxia or hypotension, some aspects are unique to the individual organ system. For instance, long bone fractures may produce fat emboli to cerebral vessels that interfere with cerebral circulation. Alterations in timing and techniques of managing such fractures may improve cerebral outcome by decreasing the risk of embolism.

Finally, cerebral injury can be influenced by systemic complications occurring during the acute phase of management. The most well established of these complications as determinants of outcome include hypotension, pneumonia, sepsis, and coagulopathy. The importance of such factors in determining outcome supports the necessity of excellent critical care in managing patients with TBI.

The biologic aspects of repair or recovery are of primary importance during the early postinjury period, while the cognitive, psychological, and behavioral issues become increasingly predominant over time. The primary processes involved in biologic neuronal recovery are (1) reparative and (2) adaptive or plastic processes. Scientists believe that, except under extremely unusual circumstances, new neurons are not formed in the mature human brain, and thus when a neuron dies, its contribution to brain function is irreparably lost. Since neuronal death apparently can be induced not only by direct trauma but also by traumatic activation of inherent biological processes of programmed cell death (apoptosis), the question of cessation or reversal of such processes is an active focus of research.

Neurons have somewhat limited capabilities of self-repair, but the physiologic underpinnings of this regeneration are not completely understood. Although some clinical evidence suggests that neuronal repair can be facilitated pharmacologically in the injured spinal cord, no clinical evidence suggests that we can favorably influence such processes in the brain.

Research in animals suggests that there are critical periods during recovery wherein interventions may be particularly beneficial. The existence of similar periods has been postulated for the injured human brain, both for biological and behavioral interventions. To date, however, no clinical evidence supports the existence of such critical periods in the human.

Another biologic recovery mechanism is adaptation. In a biologic sense, this involves the formation of new circuitry to replace that lost from trauma. There is a great deal of plasticity in the nervous system, some of which continues throughout the organism's life--for example, learning of new information. At the more macroscopic level of altering neuronal circuits to directly replace those lost, however, abilities seem to be significantly limited in the adult human brain. In the immature nervous system, such plasticity is commonplace. A primary example is the alteration of laterality of language function resulting from very early injury to the left cerebral hemisphere. Unfortunately, the ability to make adaptations of such magnitude is lost early in life and the degree to which plasticity of lesser magnitude persists or can be induced in a more mature brain remains unclear. The question of such plasticity is fundamental to the concept of restorative cognitive therapy as well as to the concept of critical periods.

Social, Behavioral, and Emotional Factors in Recovery from TBI

Neither traumatic brain injury nor its recovery can be described in purely biologic terms. The sudden onset of TBI combines with extreme changes in behavior, personality, memory, and general function to produce a catastrophic perturbation in a person's social system (Goldstein,1995; Johnston and Hall, 1994). Memory deficits and inappropriate behavior limit the ability to return to work (Treadwell and Page, 1996). Personality changes and behavioral problems mimic other pathologies such as mental retardation or psychiatric disorders. These behaviors in turn elicit negative reactions from family and friends that operate to impede the recovery process. Long-term consequences include financial dependence, social isolation (Dikmen, Machamer, and Temkin, 1993), divorce (Lezak, 1995), and various forms of incarceration such as lockup care facilities, State hospitals, or prisons.

The recovery course is partially determined by the presence or absence of factors in the survivor's social context (Goldstein, 1995). Size and strength of immediate and extended family (Kozloff, 1987), access to social services, and adequate resources (both money and programs) (Johnston and Hall, 1994) contribute to the recovery process. Aspects of the survivor's psychology, such as premorbid modes of behavior, may persist after injury (Dikmen, Machamer, and Temkin, 1993), influencing how the survivor engages in the present task of recovery. Drug or alcohol abuse (Sparadeo, Strauss, and Barth, 1990) may provide an alternative to the discomfort of persistent disorientation, confusion, and physical pain.

During the initial phase of recovery, the patient will manifest behaviors that are an immediate attempt to become oriented (Goldstein, 1995). These behaviors are often inappropriate to the context, unexpected, and may appear to be maladaptive. They are a consequence of the patient's sudden reduction in perception of the environment and ability to respond effectively to stimuli. This phase is of primary importance in rehabilitation, in that the milieu must be designed to accommodate the behaviors and not impede them. Attempts to suppress these behaviors may operate to slow the recovery process and keep a patient from engaging a new orientation. However, resistance to odd behaviors is usually a natural response from family and friends. The newly injured patient will often focus on the familiar, usually a family member, to achieve orientation; training the family to respond appropriately is an important component in establishing a context in which the patient can recover (Rosenthal and Young, 1988).

Chronic Complications of TBI

TBI can cause severe cognitive, physical, and psychosocial/behavioral/ emotional dysfunction. The most important cognitive sequelae are memory loss; difficulties with concentration, judgment, communication and planning; and spatial disorientation. Physical problems include abnormalities of muscle tone, vision, hearing, smell, taste, and speech, as well as reduced endurance, headaches, and seizures. Frequently encountered psychosocial/behavioral/emotional problems arising from TBI include anxiety and depression, mood swings, denial, sexual difficulties, emotional lability, egocentricity, impulsiveness and disinhibition, agitation, and isolation. A recent review examined papers describing the psychosocial and emotional sequelae for survivors of TBI (Morton and Wehman, 1995). The results of those studies demonstrated that survivors of severe TBI often lose friendships and social support, have limited opportunities to develop new social contacts and friends, have few leisure activities, and have high levels of anxiety and depression for prolonged periods of time. In addition to the psychosocial problems described above, categories of functional status used to describe outcomes from TBI include memory, mobility and independence, organization and productivity, physical disabilities, and inappropriate behavior.

Memory

Brain injury can cause deficits in memory that range from mild, intermittent forgetfulness to profound inability to recall anything from the past or to integrate new information. Cognitive scientists and clinicians have made distinctions in mechanisms of memory that reflect modes of memory loss. Implicit memory records information that occurs nonconsciously; explicit memory is a function of active work such as repetition. Some brain injury depletes implicit memory but not explicit or vice versa. Semantic memory allows for understanding of the meaning of words; episodic memory records time- and place-specific experiences. Procedural memory is reflected in behavioral routines; declarative memory is reflected in the ability to explicitly report.

The burden of illness with respect to memory loss depends on the scope and degree of deficit and is also context-specific. For example, loss of procedural memory may result in devastating occupational consequences to a person whose work tasks are routine. However, if that is the only affected mechanism, other intact modes of memory may substitute for the deficit, and the person may be able to learn a new skill and regain independence.

The inability to integrate new information can result in global loss of independence, especially when accompanied by intact premorbid memory. The individual clearly remembers profession, life circumstances, and family from before the injury but nothing thereafter. Because they do not remember, they do not know that they do not remember, which leads them to insist on a daily and sometimes hourly basis that they are who they used to be. A reminder of the injury may last a minute or a day but will fade with other postmorbid information. These people cannot work, and the burden of their illness is evidenced in the consequences to family and caregivers.

Mobility and Independence

Limitations in mobility and independence may result in the inability to drive or ride a bus, work and earn a living, balance a checkbook, or prepare meals. Mobility also will be affected by physical impairment and independence by degree of memory deficit. The burden is also affected by the individual's social milieu. For example, for one person the presence of family to facilitate mobility may mediate the impact of the trauma; for someone else, dependence on family may be abhorred and may compound the burden of illness.

Organization and Productivity

Many survivors of brain injury exhibit an obsession for orderliness. Some are capable of servicing the obsession to varying degrees. For example, one person's home may be cluttered and disorganized, with one room (a computer room or tool shop) in meticulous order. The burden of illness can be observed in the amount of time and energy devoted to the orderly space and the confusion and lack of productivity experienced in the disorderly environments. Often, on a daily basis, a person never disconnects from the obsessional tasks in order to engage in other productive activities.

Physical Limitations

Physical deficits include difficulty with ambulation, hearing, vision, speaking, fatigue, and use of the hands. Such deficits may result from injuries sustained at the same time as, but distinct from, the head injury, or they may result directly from brain and spinal column nerve damage.

Inappropriate Behavior

People with traumatic brain injury often lose the ability to monitor and control behavior (Lezak, 1995). They may say whatever comes to their minds, even at inappropriate times. They may misunderstand the meaning of a situation or conversation and respond according to their misunderstanding. This problem can have profound effects on a person's life, resulting in loss of work, friends, and family.

Interventions

Rehabilitation methods differ in setting, level, and range of provided therapeutic interventions, durations of treatment, and overall expenses. Lack of standard classification and different aims of therapies are problems in evaluating rehabilitation as an intervention. Three issues complicate classification of interventions:

  • 1

    General versus specific modes of classification. A very general mix of therapies constitutes the protocol of some rehabilitation programs. In contrast, other programs use intricate evaluations to identify deficits and then design interventions specific only to those deficits.

  • 2

    Discipline-driven classification. Another approach to classification of intervention for TBI is to stratify according to the discipline that generates the treatment, such as cognitive rehabilitation, occupational therapy, or physical therapy.

  • 3

    Comparison of intervention categories. In evaluating the effectiveness of a treatment, with what should the treatment be compared? Should inpatient rehabilitation be compared with outpatient, vocational with cognitive? Or should rehabilitation be compared with no rehabilitation?

The specific aims of therapy also vary widely, encompassing interventions aimed at an extremely wide range of potential outcomes, including, for example, cognitive deficits, motor disabilities, changes in emotional and social function, personality changes, and changes in appearance. As a result, therapeutic aims and perspectives vary widely among studies, as do definitions of outcome, making valid comparisons across studies difficult.

Another problem is variation in practice. Allocation of interventions appears to be arbitrary and not necessarily dictated by established standards of practice. A substantial minority (30 to 40 percent) of severely injured patients do not enter rehabilitation, while about 30 percent with mild head injury do. In one study (Dombovy and Olek, 1997), of 48 patients assessed 6 months after discharge from acute care, only 8 had received any postacute rehabilitation.

On a population basis, only a selected subset of patients with TBI undergo inpatient rehabilitation after discharge from the acute care hospital (Wrigley, Yoels, Webb, et al., 1994). Patients seen by a physiatrist during the acute hospitalization were more likely to be provided postacute rehabilitation. The presence or absence of a physiatrist at the hospital was a stronger determinant of referral to inpatient rehabilitation than clinical factors and patient characteristics that would seem to be reasonable criteria for referral (Wrigley, Yoels, Webb, et al., 1994).

Table 2. Distribution of practice settings and techniques in TBI treatment phases
Phases of treatment in TBI
Practice settings Acute IntensiveRecoverySurvival
Coma treatment centers
Acute rehabilitation programs
Long-term rehabilitation programs
Transitional living programs
Behavior management programs
Day-treatment programs
Extended intensive rehabilitation
Late rehabilitation
Independent living programs
Life-long residential
Physical therapy
Standard rehabilitation (OT, PT, speech)
Speech and language therapy
Cognitive therapy
Occupational therapy
Behavioral therapy
Psychotherapy
Social skills training

Note: Shading in the cells denotes the settings of treatment phase or application of techniques in that phase. Grid shading denotes greater correlation of phase with setting or technique.

In Table 2, interventions are mapped onto the phases from Figure 2 to illustrate which practice settings and techniques are most relevant to each specific phase of recovery.

Practice Settings

The following are practice settings. Although they are presented separately here, they often overlap to varying degrees.

  • (Coma) treatment centers--A small number of people with head injuries will remain in a minimally responsive state for months or longer after injury. A few centers will accept such individuals once they are medically stable and attempt to achieve improvement by the use of various stimulation techniques. Skilled nursing care and physical therapy are also important elements of these programs.

  • Acute rehabilitation programs are prepared to treat patients as soon as they are medically stable and are discharged from the acute hospital. Most of these are located in rehabilitation hospitals. Their primary emphasis is to provide intensive physical and mental restorative services in the early months after injury. Many will have specialized head injury units with an interdisciplinary team composed of physicians, nurses, speech and occupational therapists, and neuropsychologists. These programs are relatively short term, but longer stays may occur.

  • Long-term rehabilitation programs provide extended rehabilitation and management services. They may provide a full range of rehabilitation services for the person with brain injury who is in need of a structured environment and is making slow improvements. Such programs generally are not for permanent placements, although they may have this service available. Usually a person may remain in the program as long as there continues to be some improvement.

  • Transitional living programs--The goal of a transitional program is to prepare individuals for maximum independence, teach the skills necessary for community interaction, and work on prevocational and vocational training. Specialized programs stressing cognitive, memory, speech, and behavioral therapies are usually structured to the needs of the individual. Programs of this type are being established in a variety of settings--small group homes, special educational institutions--as part of a continuum of care in rehabilitation centers.

  • Behavior management programs--Severe maladaptive or aggressive behavior will limit an individual's participation in most rehabilitation settings. While these programs treat the common behavioral problems following head injury, many of them cannot handle destructive behavior to self or others (e.g., sexual aggression).

  • Day treatment programs are nonresidential facilities that emphasize services to upgrade functional skills. These services are similar to those described above under transitional living programs. Some offer day-care (supervision) services for those unable to benefit from an active program.

  • Extended intensive rehabilitation--the more seriously injured person may require extended therapies in a structured program that has all the elements found in the acute rehabilitation center. Emphasis will usually be on cognitive and memory retraining, speech therapy, activities of daily living (ADLs), restructuring lost social behaviors, and continuing physical therapy. Prevocational and vocational training, recreational therapy, and community reentry are usually part of each program. Patients will remain in these programs as long as progress is being made--usually 6 to 12 months.

  • Late rehabilitation--After discharge from the acute rehabilitation center, many people with head injury will need extended rehabilitation either in a residential or inpatient setting or in an outpatient program. Admission requirements may vary and be defined by a specific time after head injury.

  • Independent living programs (ILPs) are community-based services that assist people with severe disabilities living in their own homes to increase personal self-determination and independence. ILPs provide both direct and indirect services ranging from residential/transitional programs to resource referral.

  • Life-long residential programs--For those individuals unable to live at home or independently, a residential program may be the only alternative. There are very few programs of this type specifically set up for people with head injuries. Some facilities that have had experience with other disabled populations are beginning to explore this possibility.

  • The home--For some, the home environment provides the most productive setting for therapy. In addition to in-home nursing care, rehabilitation professionals may come to the client's home on a routine basis to conduct therapy sessions.

  • TBI social clubs--Although not necessarily a setting for formal rehabilitation, social clubs provide an environment in which people with TBI can associate with each other, form friendships, and instruct each other in how to manage life with a disability.

Techniques

Therapies discussed here may be provided on an individual basis or in group settings.

  • Physical therapy comprises treatment designed to restore normal physical function: walking, use of hands, use of arms, and so forth. A physiatrist may specify the course of treatment, integrating physical therapy with other programs.

  • Therapeutic recreation focuses on resuming leisure activities, community skills, and social skills.

  • Speech and language therapy--Language disruption is common with TBI and is specifically addressed in speech therapy. Speech therapy encompasses relearning appropriate methods of communication, verbal and nonverbal, as well as relearning communication of abstract thought.

  • Cognitive therapy offers retraining in the ability to think, use judgment, and make decisions. The focus is on correcting deficits in memory, concentration and attention, perception, learning, planning, sequencing, and judgment. A neuropsychologist, aided by other specialists (for example, occupational therapists [OTs], speech and language pathologists [SLPs]) may be asked to evaluate the level and kind of cognitive dysfunction following TBI, and they may reassess the individual over time to measure recovery.

  • Occupational therapy offers retraining to enable the person with TBI to cope with the routine demands of a work environment. Often the occupational tasks are at a level below that of preinjury status.

  • Behavioral therapy involves modification of maladjusted, asocial, or socially inappropriate behaviors.

  • Psychotherapy targets emotional issues, social adaptation, and self-awareness. Group psychotherapy is useful for feedback, support, and confrontation by peers. Family members may participate in therapy to help them cope with the stress of being a caregiver and to build their ability to provide appropriate in-home support.

  • Social skills training may be provided as a separate program, or it may be integrated into any of the methods described above.

Measures of Injury Severity and Disability

Table 3. Use of measures of injury and disability in phases of recovery from TBI
Phases of treatment and recovery
Scale or measure Acute Intensive Recovery Survival
Intracranial Pressure (ICP)
Brain scans (CT, MRI)
Duration of coma (DOC)
Duration of post traumatic amnesia (PTA)
Glasgow Coma Scale (GCS)
Galveston Orientation and Amnesia Test (GOAT)
Rancho Los Amigos Scale (RLAS)
Physical impairment measures
Injury Severity Scale (ISS)
Bond Neurophysical Scale (BNS)
Glasgow Outcome Scale (GOS)
Disability Rating Scale (DRS)
Functional Independence Measure (FIM)
Functional Assessment Measure (FAM)
Portland Adaptability Inventory (PAI)
Community Integration Questionnaire (CIQ)

Note: A shaded cell denotes use of the scale of measure in phase(s) of recovery. See Figure 2 for description of phases of recovery.

Table 3 lists measures that are commonly used to assess or predict the outcomes of TBI. As shown in the table, the choice of outcome measure or predictor depends on the individual's phase of treatment and recovery.

The validation of TBI rehabilitation systems and the study of neurobehavioral outcomes measurement are evolving. Currently there is no consensus on which measures of outcome should be used to assess long-term recovery.

The Glasgow Outcomes Scale (GOS) has commonly been used in the acute care literature to measure outcomes from TBI. It is widely felt to be too simple to be useful as a single indicator of outcome. The GOS (Jennett and Bond, 1975; Jennett, Snoek, Bond, et al., 1981) may be used to rate outcome during any phase of recovery and is often a part of a patient's acute hospital record (Marshall, Bowers-Marshall, Klauber, et al., 1991; Braakman, Gelpke, Habbema, et al., 1980; Narayan, Anderson, et al., 1988). It has five levels: (1) death, (2) persistent vegetative state (absence of cortical function), (3) severe disability (conscious but disabled), (4) moderate disability (disabled but independent), and (5) good recovery (resumption of "normal life"). Many studies group the various levels into poor outcome (GOS 1-3) or good outcome (GOS 4 or 5). The simplicity of the scale does not lend itself to accurate prediction of future performance, particularly for people categorized as moderately disabled (Brooks, Campsie, Symington, et al., 1986).

The Rancho Los Amigos Scale (RLA) (Hagen, 1979) is also used by acute care staff to categorize a patient's status and determine placement at discharge. It consists of eight levels of cognitive functioning: (1) no response, (2) generalized response, (3) localized response, (4) confused-agitated, (5) confused-inappropriate, (6) confused-appropriate, (7) automatic-appropriate, and (8) purposeful-appropriate.

The Functional Independence Measure (FIM) is an 18-item scale that evaluates self-care, sphincter control, mobility, communication, psychosocial Choi, adjustment, and cognitive function (Granger, Hamilton, and Sherwin, 1986). Because it serves as the outcome measure in the Uniform Data System for Medical Rehabilitation, it has been applied by inpatient rehabilitation programs to a large population of patients with diverse problems, including TBI (Guide for the Uniform Data System for Medical Rehabilitation [Adult FIM], 1993; Fiedler and Granger, 1997).

The FIM is considered to be the best single outcome scale for use during inpatient rehabilitation. However, a high score on the FIM does not necessarily mean a return to full function. For example, by FIM scores, about one-quarter of people with TBI are independent at the time of discharge from inpatient rehabilitation, and one-half are independent by 1 year after injury. Followup studies, however, suggest that people with moderate or severe traumatic brain injury are unlikely to return to competitive employment (High, Boake, and Lehmkuhl, 1995).

Attempts to circumvent this "ceiling effect" by adding more cognitive/psycho-social information to the scale (FIM + FAM [functional adaptability measure]) have met with limited success (Hall, Mann, High, et al., 1996). Judging by the FIM or FIM + FAM scores, little progress in recovery is realized after the first year postinjury. However, without evidence of such a plateau in the recovery process, the utility of these scales for long-term followup is in question. This limitation of the FIM (or FIM + FAM) is not surprising, since these indexes were designed to describe progress during rehabilitation and not functional status after discharge. In fact, therapists sometime use the attainment of threshold performance on items that are contained within the FIM as criteria for discharge.

The Disability Rating Scale (DRS) was developed to improve on the GOS as a global disability outcome tool (Rappaport, 1982). Questions on the DRS span the recovery phases, so the instrument can be used beginning in acute care through outpatient rehabilitation to track individual progress. It has been shown to have validity, high reliability, and good utility (Eliason and Topp, 1984; Hall, Cope, and Rappaport, 1985; Fryer and Haffer, 1987; Gouvier, Blanton, LaPorte, et al., 1987). The DRS also has been shown to be a good predictor of employment (Rappaport, Herrero-Backe, Rappaport, et al., 1989; Rao and Kilgore, 1992; Cope, Cole, Hall, et al., 1991) and to interact with measures of severity of injury (Thatcher, Cantor, McAlister, et al., 1991). The DRS appears to have less ceiling effect than the FIM or FIM + FAM (Hall, Mann, High, et al., 1996) but probably is not as useful as the FIM for inpatient assessment.

High scores on functional measures do not necessarily predict a successful return to the community. In response, tools to evaluate reintegration have been developed. The Community Integration Questionnaire (CIQ) is a 15-item survey that evaluates home integration, social integration, and integration into productive activities. The questions are about practical, everyday tasks that are markers of independence, such as shopping, managing finances, meal preparation, and pursuing leisure time activities. Another scale used to evaluate deficits that may impede reintegration is the Portland Adaptability Inventory (PAI) (Lezak, 1987), a set of three scales that measure temperament and emotionality, activities and social behavior, and physical capabilities.

How well do these measures predict what happens after discharge from the rehabilitation unit? One study compared estimated working capacity as evaluated at discharge with actual employment at 6 months followup (N = 147) (McLaughlin and Peters, 1993). As measured by assessment at the time of discharge, 11 percent were classified as unemployed; the actual outcome at 6 months was 39 percent. Other studies (McLaughlin and Peters, 1993; Najenson, Groswasser, Mendelson, et al., 1980; Olver, Ponsford, and Curran, 1996) found that some survivors of TBI regress as a function of their transition from one phase of treatment to the next. These observations suggest that measures taken at the time of discharge from the inpatient unit may not be valid shortly thereafter. Repeating the FIM or other standard measures some time after discharge from the inpatient rehabilitation facility might improve prediction and counteract the "ceiling effect" described earlier.

Because standard measures may fail to predict outcome for a large cross-section of survivors (Sbordone, Liter, and Pettler-Jennings, 1995), many clinics and rehabilitation programs have developed their own instruments for tracking patient progress. These instruments may be useful within their specific milieu, but their use hinders comparisons among centers and among published studies.

Long-Term Outcomes of Traumatic Brain Injury

Only a few population-based studies have been done to examine the long-term outcomes of individuals who survive traumatic brain injuries (Dawson and Chipman, 1995; Edna and Cappelen, 1987; Pentland and Miller, 1986; van Balen, Mulder, and Keyser, 1996). In a Canadian study of survivors 13 years after injury, 66 percent reported the need for ongoing assistance with some ADLs, 75 percent were not working, and 90 percent reported some limitations or dissatisfaction with their social integration (Dawson and Chipman, 1995). In a study performed in the Netherlands, 67 percent of the population with major TBI had long-term situational, cognitive, and behavioral disabilities, and only 10 percent received any rehabilitation services after the acute-care period (van Balen, Mulder, and Keyser, 1996).

Comparable population-based information from the United States is sparse. In a study of 520 Vietnam War veterans 15 years after surviving penetrating head trauma, 56 percent were employed (Kraft, Schwab, Salazar, et al., 1993; Schwab, Grafman, Salazar, et al., 1993). A registry study, the Traumatic Coma Data Bank, found that two-thirds of survivors who were employed or in school before their injury returned to work within 1 year of injury (Ruff, Marshall, Crouch, et al., 1993). A few small U.S. studies have used acute hospital discharge abstracts to identify patients with TBI. In one of these, one-third of patients were cognitively impaired and 60 percent were unemployed 6 months after discharge. Only 8 of the 48 located at followup received any rehabilitation services (Dombovy and Olek, 1997). In a study of 31 patients identified from discharge records of acute care hospitals and surveyed after 2 years, many people with moderate-to-severe head injuries remained unable to work, support themselves financially, live independently, or participate in preinjury leisure activities (Dikmen, Machamer, and Temkin, 1993).

Rehabilitation programs designed for populations of TBI survivors with all levels of deficit can achieve about 50 percent employment (Ben-Yishay, Silver, Plasetsky, et al., 1987; Prigatano, 1986). The main trends of employment postinjury are summarized by Wehman, Sherron, Kregel, and others (1993) as follows: (a) unemployment rates soar in survivors of TBI postinjury; (b) unemployment stays at very high rates of 50 to 80 percent for long periods of time, even when vocational rehabilitation services are provided; (c) wages are greatly reduced from preinjury levels; and (d) there is high job turnover among survivors postinjury.

Most information about the long-term outcomes of people with traumatic brain injury comes from followup studies of patients who underwent inpatient rehabilitation. While they are useful in understanding what to expect from inpatient rehabilitation in the long run, these studies are of limited usefulness in estimating the long-term burden of TBI in the general population for two reasons.

First, these studies exclude the large numbers of survivors who do not undergo acute inpatient rehabilitation. As noted above, patients with mild or severe injuries who enter inpatient rehabilitation units are not necessarily representative of patients generally.

Second, because survivors of TBI who have a poor outcome are relatively difficult to follow up over time, the studies may overestimate the likelihood of a good outcome. In one study, for example, the investigators vigorously tried to contact 88 people who had TBI 1 year after they were discharged from acute rehabilitation (Corrigan, Bogner, Mysiw, et al., 1997); 34 (38.6 percent) of these individuals could not be reached. People intoxicated at time of injury and those with history of substance abuse were more likely to be lost to followup. The authors noted that, among those who were contacted, these characteristics were associated with a lower probability of return to work. They concluded that "systematic bias in longitudinal studies may result from subjects with substance abuse problems being lost to followup. Population estimates for return to work or school will be overestimated if those lost who have substance use problems resemble those followed" (Corrigan, Bogner, Mysiw, et al., 1997, p. 132).

Fourteen studies concerned long-term outcomes of unselected patients with TBI after acute inpatient rehabilitation (Asikainen, Kaste, and Sarna, 1996; Corrigan, Bogner, Mysiw, et al., 1997; Dombovy and Olek, 1997; Eames, Cotterill, Kneale, et al., 1996; Fearnside, Cook, McDougall, et al., 1993; Greenspan, Wrigley, Kresnow, et al., 1996; Hawkins, Lewis, and Medeiros, 1996; High, Hall, Rosenthal, et al., 1996; Rappaport, Herrero-Backe, Rappaport, et al., 1989; Sander, Kreutzer, Rosenthal, et al., 1996; Spatt, Zebenholzer, and Oder, 1997; Tennant, MacDermott, and Neary, 1995; Whitlock, 1992; Whitlock and Hamilton, 1995). Four studies were multicenter (Greenspan, Wrigley, Kresnow, et al., 1996; Sander, Kreutzer, Rosenthal, et al., 1996; Tennant, MacDermott, and Neary, 1995; Whitlock and Hamilton, 1995). The sample size for eight studies was under 100 and ranged between 181 and 525 for six studies. Followup measures were taken at < 2 years for seven studies and at > 2 years for six studies. In these studies, between 13 percent and 40 percent of subjects could not be reached for followup.

In general, patients show substantial improvements in physical, cognitive, and other functions between the time of admission to a rehabilitation facility and the time of discharge or at long-term followup. At the same time, continued morbidity and disability are common. Eight of the studies addressed postinjury return to productive activity. Postinjury unemployment ranged from 28 percent to 75 percent across these studies (Asikainen, Kaste, and Sarna, 1996; Dombovy and Olek, 1997; Fearnside, Cook, McDougall, et al., 1993; Greenspan, Wrigley, Kresnow, et al., 1996; Hawkins, Lewis, and Medeiros, 1996; Rappaport, Herrero-Backe, Rappaport, et al., 1989; Sander, Kreutzer, Rosenthal, et al., 1996; Spatt, Zebenholzer, and Oder, 1997). Employment in a job below preinjury level or with reduced hours and demand ranged from 7 percent to 34 percent.

Studies differed widely in the methods used to measure return to work. Accounting for differences in measurement and the impact of injury severity on the probability of returning to work, it appears that more than half of survivors of TBI become unemployed as a consequence of their condition. For example, some samples combined survivors who retired with those who were unemployed or placed on disability. Also, some studies did not account for preinjury unemployment. At 1-year followup, one study reported 75 percent unemployment; preinjury unemployment for that sample was 19 percent (Hawkins, Lewis, and Medeiros, 1996). Forty-one individuals had an initial GCS of 3 to 8, suggesting a group with severe impairments, which could account for the high unemployment ratio. The study with the lowest postinjury unemployment ratio retrospectively evaluated 496 survivors up to 20 years after injury (Asikainen, Kaste, and Sarna, 1996). In that sample, 285 (58 percent) had an initial GCS of 3 to 8; postinjury unemployment was 28 percent, with an additional 14 percent working at jobs below the preinjury standard.

Seven studies used long-term followup to assess community reintegration (Eames, Cotterill, Kneale, et al., 1996; Fearnside, Cook, McDougall, et al., 1993; Hawkins, Lewis, and Medeiros, 1996; Rappaport, Herrero-Backe, Rappaport, et al., 1989; Tennant, MacDermott, and Neary, 1995; Whitlock, 1992; Whitlock and Hamilton, 1995). Type of placement at discharge from inpatient rehabilitation is often used as an indicator of community reintegration. It is difficult to compare the results of different studies because the categories for disposition at discharge vary. Also, a postinjury living status of "alone" may indicate a high level of independence and a successful recovery, or it may indicate social isolation and a decrease in quality of life. Thus, postinjury status without a measure of change from preinjury status may not be an accurate indicator of the effect of the trauma.

To estimate the impact of TBI on community integration, we categorized disposition as either discharged to home or to an institution such as a skilled nursing facility, long-term rehabilitation center, hospital, prison, etc. In six studies that measured this outcome, the proportion of people institutionalized after discharge from inpatient rehabilitation ranged from 6 percent to 52 percent (Eames, Cotterill, Kneale, et al., 1996; Fearnside, Cook, McDougall, et al., 1993; Hawkins, Lewis, and Medeiros, 1996; Rappaport, Herrero-Backe, Rappaport, et al., 1989; Whitlock, 1992; Whitlock and Hamilton, 1995).

A study performed in New South Wales, Australia, had the lowest proportion of institutionalized survivors (6 percent) (Fearnside, Cook, McDougall, et al., 1993), perhaps reflecting national cultural differences that would result in a greater number of people being discharged to home rather than to an institution. The highest proportion of institutionalized survivors in these studies was 52 percent (Whitlock, 1992). Of 23 respondents, 11 had returned home, and 12 were in skilled nursing facilities at 1-year followup. Comparing the results of these studies, it appears that institutionalization of roughly half of TBI patients persists beyond 1 year.

Injury severity and preadmission disability affect the probability that a patient will eventually go home as opposed to being institutionalized. In the studies cited above, initial injury severity and preadmission disability were measured by a wide variety of methods, including FIM scores, GCS scores, length of stay in acute care, PTA (post-traumatic amnesia) duration, coma duration, and novel measures designed by the researchers conducting the investigation; each sample contained its own mix of severity levels. Given the inconsistencies in measurement and categorization and differences due to culture and resources, the probability of a patient being in a long-term care facility cannot be estimated from these studies.

One study used the FIM to evaluate outcome at 1 year after discharge from rehabilitation (Hawkins, Lewis, and Medeiros, 1996). As measured by the FIM at 1 year after discharge, 43 of 51 survivors (84 percent) were independent in self care, 42 (82 percent) in locomotion, 27 (53 percent) in communication, and 21 (41 percent) in cognition. In another study (Whitlock, 1992), 20 of 23 patients improved on FIM scores from admission to discharge. However, for this same group, only five patients improved on the GOS between 6 months and 1 year postdischarge. Seventeen stayed the same (one patient was not included in the 1-year assignment). Other studies that used the GOS to estimate functional status present sample proportions with good outcomes ranging from 24 percent to 79 percent (Hawkins, Lewis, and Medeiros, 1996).

Predictors of Outcome

A large number of studies have examined the predictive ability of patient characteristics known at the time of admission to inpatient rehabilitation units (Cowen, Meythaler, DeVivo, et al., 1995; Lehmann, Steinbeck, Gobiet, et al., 1996; Malec, Smigielski, De Pompolo, et al., 1993; Saneda and Corrigan, 1992; Spatt, Zebenholzer, and Oder, 1997; Torkelson, Jellinek, Malec, et al., 1983; Vilkki, Ahola, Holst, et al., 1994; Zafonte, Hammond, Mann, et al., 1996). Variables that have been associated with long-term outcomes include:

  • Preinjury characteristics such as diseases, psychological conditions, and social and economic issues.

  • Age and sex.

  • Severity of brain injury (site, severity, mechanism of injury, secondary insults such as hypotension or hypoxia, etc.).

  • Severity and influence of extracranial injuries and complications of acute-care hospital care.

  • Length of time between the initial injury and the initiation of rehabilitative treatment.

The Glascow Coma Scale (GCS) score is the instrument most intensively studied (Teasdale and Jennett, 1974). This scale, ranging from 3 to 15 points, reliably and repetitively describes the level of consciousness of the patient with TBI. When it is carefully scored at the completion of resuscitation, the GCS is highly predictive of outcome measured by the Glasgow Outcome Scale (GOS) (Jennett and Bond, 1975) at 3, 6, and 12 months after injury (Braakman, Gelpke, Habbema, et al., 1980; Choi, Narayan, Anderson, et al., 1988; Levin, Gary, Eisenberg, et al., 1990; Marshall, Gautille, Klauber, et al., 1991). However, emergency departments vary in who performs the assessment (neurosurgeon versus emergency department staff) and when it is performed (before or after blood pressure and hypoxia are stabilized) (Marion and Carlier, 1994); these variations can affect the ability of the GCS to predict outcome (Bullock, Chesnut, Clifton, et al., 1998). Attention to these details has been lacking in the literature to date, even in quasiexperimental studies that use the GCS as a covariate.

In addition to the GCS, four other indicators are useful. A recent evidence-based literature analysis done for the World Health Organization as part of the Guidelines for the Management of Severe Head Injury has outlined the operating definitions of these variables and the optimal methods for their collection and has suggested that they be controlled via multivariate analysis in all subsequent TBI outcome prediction studies (Bullock, Chesnut, Clifton, et al., 1998).

Pupils

The status of the pupils (an indicator of intracranial pressure or herniation) helps predict outcome (Marshall, Gautille, Klauber, et al., 1991).

Age

Age is usually (Jennett, Teasdale, Galbraith, et al., 1979; Vollmer, Torner, Jane, et al., 1991; Waxman, Sundine, and Young, 1991; Braakman, Gelpke, Habbema, et al., 1980; Choi, Narayan, Anderson, et al., 1988) but not always (Reeder, Rosenthal, Lichtenberg, et al., 1996) found to predict GOS and function (FIM) after rehabilitation. Age appears to be a primary predictor independent of age-related factors such as systemic illnesses (Vollmer, Torner, Jane, et al., 1991).

Systemic Hypotension

The presence of severe systemic injuries is also correlated with worse outcome (Bowers and Marshall, 1980; Klauber, Marshall, Luerssen, et al., 1989; Mayer, Walker, Shasha, et al., 1981). However, when systemic hypotension occurring during the period between injury and the end of resuscitation is controlled, the influence of systemic trauma drops out (Chesnut, Marshall, Klauber, et al., 1993). This suggests that the influence of injuries to extracranial organ systems on outcomes from TBI is primarily mediated by the associated hypotension.

Intracranial Computer Tomographic (CT) Diagnosis

It would seem logical that the location, extent, and severity of damage to the brain would be predictive of outcome from TBI. Although prediction studies have correlated outcome with various parameters consistent with severity of brain injury such as skull fracture, intracranial hematoma, or presence of surgical mass lesions (Bergman, Rockswold, Haines, et al., 1987; Braakman, Gelpke, Habbema, et al., 1980; Jennett, Teasdale, Galbraith, et al., 1979; Waxman, Sundine, and Young, 1991), no one has yet demonstrated the expected degree of anatomic specificity in predicting recovery or residual deficits. This may be largely a question of defining the extent of brain injury based on the rather limited technology of computed tomography and magnetic resonance imaging. To date, the Traumatic Coma Data Bank classification of the CT imaging of the brain during the acute-care course is the most promising method of incorporating the anatomical nature of the brain injury into a predictive model (Marshall, Bowers-Marshall, Klauber, et al., 1991).

Other Variables

Other variables that have been suggested as predictive of outcome, as measured by GOS, include mechanism of injury (Waxman, Sundine, and Young, 1991), brainstem reflexes (Born, Albert, Hans, et al., 1985), evoked potentials (Anderson, Bundlie, and Rockswold, 1984), cerebrospinal fluid (CSF) catecholamines (Woolf, Hamill, Lee, et al., 1987), degree and severity of intracranial hypertension (Alberico, Ward, Choi, et al., 1987; Jones, Andrews, Midgley, et al., 1994; Marmarou, Anderson, Ward, et al., 1991), jugular venous desaturation (Gopinath, Robertson, Contant, et al., 1994; Jones, Andrews, Midgley, et al., 1994; Robertson, Contant, Gokaslan, et al., 1992), cerebral perfusion pressure (Gopinath, Robertson, Contant, et al., 1994; Jones, Andrews, Midgley, et al., 1994; Robertson, Contant, Gokaslan, et al., 1992), fever (Jones, Andrews, Midgley, et al., 1994), and in-hospital hypotension (Chesnut, Marshall, Piek, et al., 1993; Jones, Andrews, Midgley, et al., 1994). The statistical independence of these various factors remains to be clearly delineated. It cannot be suggested at this time that they be included as potential injury severity confounding variables in rehabilitation studies. When planning such investigations, however, the present state of the literature must be assessed since some of these indexes, or variations thereof, may develop as mandated covariables.

Two other indexes, duration of PTA and coma, are frequently used in quasiexperimental studies to adjust for severity of injury. Both of these are determined at some time following the injury.

The use of PTA originated with Russell and colleagues in the 1930s (Russell, 1932; Russell, 1935; Russell, 1971; Russell and Nathan, 1946; Russell and Smith, 1961). Russell classified injuries with PTA < 5 minutes as very mild; 5 to 60 minutes as mild; 1 to 14 hours as moderate; > 24 hours as severe; > 1 week as very severe; and > 4 weeks as extremely severe. In a study of 1,766 patients, Russell and Smith (1961) found the duration of PTA to be the single best predictor of neurological outcome.

In many studies, PTA is measured retrospectively by reviewing patient charts. Unfortunately, retrospective PTA is unreliable (Gronwall and Wrightson, 1980). PTA is best determined prospectively using as an index the attainment of a criterion score (e.g., 85 percent) on the Galveston Orientation and Amnesia Test (GOAT) (Levin, O'Donnell, and Grossman, 1979).

It is difficult to reconcile PTA with the more commonly used GCS score as an index of TBI severity. Using a PTA of > 24 hours as their criterion for the diagnosis of severe TBI, Bishara and colleagues found that 81 percent of such patients attained a good outcome (GOS 4-5) at 1 year (Bishara, Partridge, Godfrey, et al., 1992). This contrasts with only 43 percent of patients achieving such an outcome in the Traumatic Coma Data Bank (TCDB), where severe head injury was defined as a postresuscitation GCS = 8 (Marshall, Gautille, Klauber, et al., 1991). Such a discrepancy suggests that these two indexes cannot be used interchangeably as they will be predictive of markedly different courses of recovery.

Duration of coma has been used to quantify the severity of brain injury and to predict outcome. Patients in coma for < 20 days frequently regain independence in functional activities, whereas those who remain in coma > 20 days are usually profoundly disabled (Jones, 1981; Pazzaglia, Frank, Frank, et al., 1975). Like the PTA, duration of coma is unreliable when determined retrospectively, and it is not interchangeable with the GCS score. In addition, its determination can be confounded by the use of medications which are commonly administered during treatment of TBI patients.

Average LOS in acute care after TBI has been used as a gross indicator of the "sickness" of the patient during the immediate, posttraumatic period. More recent studies have reported acute care stays ranging from 20 to 60 days (Lehmkulh, Hall, Mann, et al., 1993; Mackay, Bernstein, Chapman, et al., 1992; Sakata, Ostby, and Leung, 1991; Sparadeo and Gill, 1989). Unfortunately, this variable is sensitive to socioeconomic issues, which may be difficult to control when using it as an indicator of trauma severity.

The above considerations reveal that the prediction of outcome based on physiologic indicators of TBI remains in a state of active development. At present, a credible attempt to control for (or match on) severity of illness should include the five best physiologic indicators described above. Older studies frequently do not use these indicators, the importance of which was not clearly established until recently.

Even today, retrospective analyses are hampered by the lack of reliability and absence of the necessary data in patient charts. Properly approaching this problem in the future will require a coordinated effort in data collection beginning at admission and continuing through rehabilitation wherein common definitions are used throughout.

Chapter 2. Methods

Topic Assessment and Refinement

Two panels of experts worked with the research team to identify key questions in the rehabilitation and survivor phases for adults with TBI. The first panel was composed of two physiatrists, a survivor of TBI, the wife of a survivor of TBI, a State vocational rehabilitation counselor, a neuropsychologist, a psychologist, a clinical coordinator of an outpatient TBI rehabilitation program, and a rehabilitation clinical nurse specialist, all from the Portland, OR, area. The second panel was composed of nationally recognized experts in rehabilitation.

The local panel met twice to establish the scope of the literature review, develop a common understanding of the main concepts bearing on questions of effectiveness in rehabilitation, and identify key questions for investigation. Prior to the first local panel meeting, members were sent a document describing the prevalence, incidence, and burden of illness of TBI and a list of treat-ment settings and techniques. At the first meeting, one of the investigators explained the use of a causal pathway diagram (Woolf, Battista, Anderson, et al., 1990) to enumerate causal links and identify key clinical questions about an intervention. Causal pathways highlight the role of intermediate measures of outcomes, which are often used as proxies for health outcomes in clinical studies and in practice. The format of the meetings was semistructured to promote free interaction aimed at identifying issues with respect to TBI rehabilitation among representatives of the various disciplines. Proposed questions and elements of causal pathways were documented and synthesized for review by the national panel.

Prior to the first meeting of the national panel, members were provided the same briefing given the local panel members, along with a summary of material generated from the local panel's meetings. During the national panel meeting, members were asked to consider the proposed questions, add to or delete from the list, and elaborate on the revised list of questions. The research team synthesized this second level of input and distributed draft questions for study to both panels. Panel members submitted revisions to the task order manager, who coordinated input and continued to distribute new iterations of the questions until consensus was reached.

The panels formulated five questions pertaining to the phases of recovery described in Figure 2. These questions addressed the effectiveness of (1) early rehabilitation in the acute care setting (timing), (2) intensity of rehabilitation, (3) cognitive rehabilitation, (4) supported employment, and (5) care coordination (case management). For each of these questions, members of the research team worked with panelists to write a brief rationale for the question, define key terms, and specify the relevant patient populations, interventions, and outcome measures that should be examined in the literature review (Appendix 1). Detailed information for each question is provided in Chapter 3 (Results) of this report.

Literature Retrieval

Literature was searched using MEDLINE, CINAHL, HealthSTAR, and PsycINFO. In addition, the Cochrane Collaboration made available a database of about 500 articles on brain and spinal cord injury. Four MEDLINE search strategies were written. A single strategy was designed to seek references regarding the timing and intensity of acute care rehabilitation (questions 1 and 2). Three additional search strings were used to find articles on the remaining questions (3, 4, and 5). The full MEDLINE database was searched for randomized controlled trials; otherwise, MEDLINE was searched from 1976 to 1997. One additional search strategy, designed to capture literature for all five questions, was written for each of the remaining databases used (CINAHL from 1982 to 1997, HealthSTAR from 1995 to 1997, and PsycINFO from 1984 to 1997). The search strings are given in Appendix 2. Finally, we searched the Cochrane database for articles about rehabilitation. We referred to the Current Contents database on a monthly basis between November 1997 and May 1998 to ensure we did not miss new literature that might be relevant.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3309_f2-3.jpg.

   Figure 3. Chart of search and selection of articles for review

Articles reviewed and cited

Figure 3 shows the results of the search. The MEDLINE search retrieved a total of 2,271 references. The CINAHL search retrieved 431 articles, HealthSTAR 55, and PsycINFO 339. Members of the research team read the abstracts from CINAHL, HealthSTAR, and PsycINFO and assigned them to one or more of the five questions. Two Cochrane references were also retrieved (the Cochrane database contained primarily pharmaceutical studies). After removal of duplicates, 2,536 citations remained.

Table 4. Exclusion criteria for review of abstracts
General review criteria
Question specific review criteria
Not traumatic brain injury (e.g., carbon monoxide poisoning)
Pediatric
Pharmacology study
Case study
Instrument development
Alcohol/drug use
Stroke
Editorial
Acute care
Foreign language
No data
Methods
Not rehabilitation
Wrong independent variable
Wrong dependent variable
Two members of the research team read the 2,536 abstracts and applied the eligibility criteria, which are listed in Table 4. The criteria were designed to be broad and generally inclusive of studies with data from at least a series of people undergoing rehabilitation for traumatic brain injury. When the two reviewers disagreed, a third reviewer read the abstract and cast the deciding vote on whether to include it. For citations without abstracts or when the title of the abstract was not sufficient to determine its status, the full article was retrieved and reviewed to determine its eligibility. The reviewers examined each abstract and indicated whether it met the inclusion criteria and, if not, the reason for exclusion. Appendix 3 shows the results of a reliability test between reviewers.

Table 5. Topics addressed by reviewed articles
Review questions
Article subjectQuestions 1 and 2Question 3Question 4Question 5All questions
Population-based study30115
Longitudinal study239172170
Intervention17472714105
Effectiveness1172323
Measures2215122574
Predictors104161040
Followup2192133
Outcomes00538
Totals87838998358

Note: Entries in cells show number of articles dealing with each subject for each review question. Articles may address more than one subject or appear in more than one review question.

Eighty-seven articles pertaining to questions 1 and 2, 114 for question 3, 93 for question 4, and 69 for question 5 passed the eligibility screen. The full text of these articles was retrieved, and the articles were reviewed using the data abstraction instrument described below. Each article was assigned one or more categories, such as "longitudinal," "effectiveness," "interventions," etc. (Table 5). Categories were noted in the database for each article to allow for electronic search of subsets of articles containing specific information.

Literature Synthesis

Data Abstraction

We designed an instrument to record data abstracted from each eligible article (Appendix 4). The instrument includes items for patient characteristics, interventions, cointerventions, outcomes, study methods, relevance to the specific research questions, and results of the study. The instrument has two components: the first three pages of the instrument apply to all articles specified for inclusion in the study. The remaining pages are individual instruments that apply to one of the five questions. To abstract an article, a reader used the initial abstraction instrument plus one or more of the five question-specific instruments.

The first few questions of the initial abstraction instrument allowed the reviewer to determine if the article actually met the eligibility criteria listed in Table 4. If an article was determined to be ineligible, it was passed to a second reader for confirmation. As shown in Figure 3, 143 articles were eliminated at this phase based on initial eligibility criteria. The remaining 220 articles, plus an additional 67 articles recommended by technical experts or found in the reference lists of reviewed articles (total 287), were subjected to the full abstraction protocol.

Managing the Database of Articles

Retrieved articles were kept in an electronic database (EndNotes PlusTM). User-defined fields were used to record results of the eligibility screen, review for inclusion, and number of reviews performed. Paper copies of the articles were maintained in a master file. Throughout the literature review process, any articles identified from sources such as bibliographies or reference lists, manual searches of journals not contained in electronic databases, or references recommended by outside parties were added to the electronic databases.

Specification of Level of Evidence

We used a three-level system to rate individual studies:

  • Class I

  • Properly designed randomized controlled trials.

  • Class II

  • Class II(a): Randomized controlled trials that contain design flaws preventing a specification of Class I. An example of a design flaw is failure to blind raters or lack of followup data.Class II(a): Multicenter or population-based longitudinal (cohort) studies.Class II(b): Controlled trials that were not randomized.Class II(b): Case control studies.Class II(b): Case series with adequate description of the patient population, interventions, and outcomes measured.

  • Class III

  • Descriptive studies (uncontrolled case series).Expert opinion.Case reports.Clinical experience.

A well-done, prospective, multicenter or population-based cohort study can provide valuable information that, in some ways, is more representative of results in actual practice than are data from a randomized trial done in a highly selected sample. However, an uncontrolled case series is generally classified as Class III, indicating a low level of confidence for inferences about effectiveness.

Why is a control group needed to make inferences about effectiveness? Information about the long-term natural history of TBI provides too little certainty about the outcome to forgo the use of a control group. If the consequences of brain injury in the absence of rehabilitation could be predicted accurately, a control group would not be needed. Some evidence suggests a natural course of recovery from TBI in both basic and complex functions (Dikmen, Reitan, and Temkin, 1983), especially in the first 6 months after injury (Bond, 1979; Levin, Benton, and Grossman, 1982; Levin, Gary, Eisenberg, et al., 1990). After 6 months, survivors of TBI recognize their disabilities as they stabilize and often maximize their functional status, but major deficits in social and leisure activities tend to persist (Oddy and Humphrey, 1980).

A "gray zone" exists between Class II and definite Class III articles. Much of the research in rehabilitation uses quasiexperimental designs. In these observational study designs, control groups are sometimes identified from a separate population of people with TBI. One study compared patients undergoing inpatient rehabilitation with a sample of people with TBI who had been treated in a region of the country where formal inpatient TBI rehabilitation was not available (Aronow, 1987). This was an entirely separate patient group, and all the data except outcome measures came from an independent database.

The main difficulty with the quasi-experimental design is lack of control over the constitution of the compared groups. Since there is no randomization and generally no control over the details of the selection process through which the study participants received their separate therapies, the groups are likely to differ in the frequency of characteristics that are associated with the outcomes of interest. Even when significant efforts are made to match the experimental and the quasicontrol groups, groups still are likely to differ significantly.

Quasiexperimental designs rely heavily on multivariate statistical analysis and matching to counter this problem. While this is common practice, making inferences about effectiveness from statistically controlled data is controversial because these methods do not necessarily guarantee that the results are reliable or that serious bias and confounding have been eliminated. There are at least three major barriers to accuracy in the practice of statistical adjustment for risks. First, all of the confounding variables must be recognized and be associated with accurate and reliable measurement instruments. Second, data on all of these confounding variables must be available in comparable formats in the compared groups. For example, in the study mentioned earlier, baseline data, such as admission functional status scores, may be available for patients who entered inpatient rehabilitation but missing for patients who did not. Third, statistical methods must be selected and applied properly.

Since the first two barriers are virtually never overcome and the third remains somewhat controversial, the execution of a statistically valid quasiexperimental study is a daunting and generally unrealized task. Most studies using retrospective data suffer from the absence of well-measured data on a number of important confounding variables. The few prospective studies generally suffer from a lack of consensus on the proper measurement instruments for many of these variables. Finally, while the standard of practice for use of statistical methods to remove confounding is not completely defined, many studies do not use, or fail to report, available methods to improve the reliability and robustness of these methods.

Much of the literature relevant to the five questions addressed in this report falls into the "gray zone" between Class II and Class III. For this reason, critical appraisal of key studies plays a particularly important role in this review. A number of characteristics of these studies were considered relevant to all rehabilitation questions and were recorded in the data abstraction form. Evaluation of the following factors played a major role in critically appraising these articles:

  • Prospective collection of data.

  • Complete description of parent patient population.

  • Large study population size (driven by hypothesis, power, type I error threshold).

  • Study setting--a single center, many centers, or population-based.

  • Descriptions of reasons for referral to service being studied.

  • Methods described completely enough to allow study replication.

  • Complete description of rehabilitation technique in question (independent variable).

  • Complete and adequate description of differences between "control" and "experimental" groups.

  • Conditions determining whether study subjects did or did not receive the rehabilitation technique in question.

  • Information about potential confounders, including types and severity of injury; age; and others (including, in some cases, economic status, educational level, lack of family support).

  • Measurement of confounding variables using instruments validated as accurate, sensitive, and reliable.

  • Payer group.

  • Choice of outcome variables that are meaningful to survivors as well as caregivers.

  • Use of functional status and other health outcomes rather than surrogate intermediate outcomes.

  • Measurement of outcome variables using instruments validated as accurate, sensitive, and reliable.

  • Timing of outcome measurements.

  • Assessment of survivor characteristics and outcomes by blinded observer.

  • Use of multivariate statistical analysis: Were interactions sought and controlled for? Were risk estimates calibrated? Were all relevant confounders included as candidate variables?

The criteria used to classify articles and the features to be considered in critically appraising them were discussed at the subcommittee, committee, national expert panel, and Aspen Neurobehavioral Conference levels with the goal of maintaining consensus on at least the relative stratification of individual articles.

Construction of Evidence Tables

Evidence tables were constructed to summarize the best evidence about effectiveness pertaining to each question. For questions 1 and 2, there were no randomized trials and only a few quasiexperimental studies. There were many relevant observational studies of important relationships (for example, the relation of survivor characteristics to outcome); while we discuss these results, we chose not to summarize studies that concerned individual causal links or relationships in evidence tables. For question 3, addressing cognitive rehabilitation, 15 randomized controlled trials and comparative studies that met specified inclusion criteria (see the section on question 3) were placed into evidence tables. All comparative studies located for the last two questions, which addressed supported employment and care coordination, were included in evidence tables.

Critical Appraisal of Key Articles

For each of the five questions, we formed subcommittees of one to two members of the research team and one to two members of the local technical panel. A member of the research team chaired each subcommittee. The principal investigator also led subcommittees consisting of members of the national expert panel. All members of the subcommittees reviewed key articles relevant to the assigned question. These reviews were discussed among the various members of the subcommittees, and the results were summarized by the chair. This was an attempt to ensure that the summary statements on the research questions reflected the expertise and experience of a variety of technical experts with relevant skills and training. These interpretive efforts addressed the methods and results of individual studies, their ratings, and their scientific importance.

The principal investigator read all of the critical articles for the five questions. Summaries were presented and discussed with national experts at the Aspen Neurobehavioral Conference in April 1998 (see Appendix 6).

Chapter 3. Results

The results are presented in five sections, one for each of the questions listed in Appendix 1. When necessary, we provide additional information about background and methodology before the discussion of results for each section.

Question 1: Should interdisciplinary rehabilitation begin during the acute hospitalization for traumatic brain injury?

It is widely accepted that patients with severe head injury should undergo a course of inpatient rehabilitation immediately after discharge from the acute care hospital. A retrospective study demonstrated that patients admitted to rehabilitation units less than 35 days after injury required less rehabilitation to achieve the same functional level as those admitted more than 35 days after injury (Cope and Hall, 1982). This study raised the question of whether interdisciplinary rehabilitation should be started earlier than was customary.

Early neurological rehabilitation means starting rehabilitation of brain damaged patients as soon as possible during the acute phase of the trauma or illness, often while the patient is still unconscious. The components of early rehabilitation might include a multidisciplinary family conference and a baseline assessment by a physiatrist, occupational therapist, physical therapist, and when the patient is conscious or has a tracheotomy, a speech therapist (Sherburne, 1986).

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3309_f3-4.jpg.

   Figure 4. Casual pathway for early neurological rehabilitation in the acute hospital setting

Note: FIM=Functional Independence Measure
GOS=Glasgow Outcome Scale

Figure 4 shows a causal pathway linking early rehabilitation to potential benefits. Direct comparisons of early rehabilitation with usual care in randomized trials (represented by arcs 1, 2, and 3) would provide the strongest evidence about costs and effectiveness. Because such evidence is not available, the effects of early rehabilitation on costs and outcome must be inferred from indirect, observational studies of each causal link. In general, the opportunities for bias and confounding make it hazardous to make inferences about effectiveness from observational studies (High, Boake, and Lehmkuhl, 1995).

The remaining arcs represent indirect evidence. On the left of the figure, the first link in the causal chain is that early rehabilitation might reduce the total length of stay for the acute admission and rehabilitation combined (arc 4). The next link is that a shorter length of stay would reduce the total costs of care (arc 7). On the right, the first link is that patients who undergo early rehabilitation will be discharged to the inpatient rehabilitation service in better condition than those who receive usual care (arc 5). The next link is that, as a result, scores on functional assessment instruments at the end of rehabilitation will be the same or better as in usual care, despite the shorter length of stay (arc 6). An implicit assumption, indicated by arc 8 in the figure, is that better scores on these assessments translates into better health outcomes after discharge from the rehabilitation unit.

Although such evidence cannot ever be as strong as evidence from a well-conducted experimental trial, certain methods of study design or analysis can improve the reliability of the findings. First, the baseline characteristics of the patients in the compared groups should be described in detail using reliable measures of severity, comorbidity, and other information that might be associated with the outcome of interest. At a minimum, these measures are age, GCS scores, and indicators of severity and mechanism of injury, multiple injuries, and preinjury function. Second, matching, stratification, or statistical adjustment for these risk factors should be used to minimize the influence of confounders on the study's observed results. We used these study characteristics as inclusion criteria to identify high-quality studies of the relations depicted in the causal pathway. Third, the study must report at least one relevant outcome measure, such as:

  • Presence or absence of complications.

  • Length of stay in the hospital.

  • Costs of immediate care and long-term financial burden.

  • Health status at discharge from the acute care hospital.

  • Long-term measure of impairment.

  • Long-term measure of disability.

Of the 87 articles that passed the eligibility screen and were assigned to Questions 1 and 2, 14 were potentially relevant to the timing of intensive rehabilitation. Of these, two were review articles (Cope, 1995; Jorgensen, 1997), three were studies that contained no original data (Johnson and Roethig-Johnson, 1989; Kock and Fuhrmann, 1992; Kosubek, Feldmann, and Schwendemann, 1996), and one was a case report (Sherburne, 1986). The eight remaining articles are discussed below.

Direct Evidence

There is no direct evidence from randomized trials about the effect of early neurological rehabilitation on health outcomes.

Indirect Evidence

Comparative studies

No prospective, randomized controlled trials of the effects of early rehabilitation on length of stay, condition at the time of entry into a rehabilitation unit, or long-term costs have been done. Moreover, no nonrandomized (observational) controlled study fully met the criteria described above.

Mackay and colleagues (Mackay, Bernstein, Chapman, et al., 1992) conducted the premier study of integrating formal rehabilitation into the acute-care setting. Although the study has serious limitations, it is the only study to compare groups of patients that clearly received different rehabilitation interventions during the acute phase of TBI (see Evidence Table 1). The authors looked retrospectively at 38 severely injured patients (GCS 3-8 on admission at the trauma center) consecutively discharged from inpatient rehabilitation between 1984 and 1990. These patients had been transferred from 11 different acute care hospitals. Nonformalized acute rehabilitation was performed at 10 hospitals. Acute, formalized early rehabilitation was performed at a single hospital. Formalized trauma rehabilitation was described as: ...evaluation and treatment on admission to the acute hospital by a physiatrist, physical therapist, occupational therapist, and speech and language pathologist. This intervention, which continued throughout the acute admission, involved structured multisensory stimulation, orientation, exercise, and positioning to decrease posturing and help prevent contractures and sensory deprivation. Goal-oriented treatment was provided by using a variety of early intervention approaches from both a rehabilitative and preventive framework (Mackay, Bernstein, Chapman, et al., p. 637).

This program was initiated very early at the formalized rehabilitation hospital, uniformly beginning while patients were in coma an average of 2 days after admission. At the 10 nonformalized acute rehabilitation hospitals, therapy was started during coma in 42 percent of patients, an average of 23 days after admission. For the nonformalized group, 14 percent received only physical therapy, 65 percent did not receive speech therapy, and 14 percent did not receive any rehabilitation.

Severity of injury was rated using GCS score, injury severity score (ISS), RLA score, pupillary and pain responses, CT scans, associated injuries, and surgical interventions. The main outcome variables were LOS at the trauma and rehabilitation hospitals and condition on discharge from the rehabilitation unit (length of coma, RLA at discharge from acute care and rehabilitation).

The authors found that the patients in the formalized treatment group had coma durations and rehabilitation stays about one-third the length of patients in the nonformalized group. There was no difference in acute hospital LOS. The acute LOS ranged from 50 to 60 days. The rehabilitation LOS was 106 days for the formal system and 239 days for the nonformal system, giving rather long total mean LOS of 158 days and 303 days, respectively. Physical/motor, sensory/perceptual, and cognitive/language outcomes were better for the formalized group. These were scored using a specified but nonstandardized rating system. The differences in length of coma, rehabilitation LOS, total LOS, and RLA at discharge from the acute hospital remained large and statistically significant after statistical adjustment for the initial GCS and RLA scores.

Is it plausible that providing comprehensive rehabilitation during coma could reduce the average length of coma by 35 days? The patients in the compared groups were similar in age, associated injuries and initial GCS, ISS, and RLA scores. However, other predictors of a long length of stay in rehabilitation, such as more detailed head CT findings (Cowen, Meythaler, DeVivo, et al., 1995), extremity fracture, and FIM scores (High, Hall, Rosenthal, et al., 1996), were not recorded. As others have pointed out (High, Boake, and Lehmkuhl, 1995), the sample consisted of 38 patients recruited over 6 years, and it is not clear whether they were representative of patients with severe head trauma generally.

A major weakness of the paper is that the results are reported only as means for the compared groups, making it impossible to determine how many patients in the formal early rehabilitation benefitted. Because of the small sample size, it is possible that the very large difference in length of stay reflects the influence of one or more outliers in the group who did not receive formal early rehabilitation. Moreover, no information is provided about the reasons for the longer LOS in this group, so the mechanism by which early rehabilitation might have affected rehabilitation LOS is not clear.

Does earlier transfer to a rehabilitation unit affect rehabilitation LOS (arc 4)?

A number of studies have examined whether early initiation of rehabilitation during the acute hospitalization for TBI is associated with a shorter rehabilitation LOS. The evidence presented in these studies is indirect because early transfer to a rehabilitation unit is not the same, or even necessarily similar, to initiating rehabilitation in the days immediately following postinjury stabilization.

As mentioned earlier, Cope and Hall (1982) retrospectively analyzed the influence of early rehabilitation on hospital LOS and costs. They arbitrarily defined the threshold dividing early and late rehabilitation as 35 days based on the median interval between injury and admission for their overall patient group. They matched two groups of patients (16 early and 20 late patients) for length of coma and analyzed other variables between groups including age, acute GCS (assigned retrospectively), DRS and GOS at entry to rehabilitation, evoked potentials, continence, social status, and physiological impairment (rated on an unspecified set of tests). None of these differences were statistically significant by t-statistics, but the researchers did not use multivariate analysis.

Acute hospitalization days, acute-rehabilitation days, and total hospital days were all greater in number, reaching statistical significance, in the delayed-rehabilitation group. Total hospital stay was over twice as long. Of interest, when the researchers looked at outcome measures at the time of discharge, both the DRS and the GOS appeared similar, suggesting that the patients reached a comparable level of recovery at the time of discharge.

As the authors noted, the most important limitation of this study is that the ability to match the compared groups is very limited. It seems likely that rehabilitation was started earlier in some patients because they were doing better to begin with. In addition, as in the Mackay, Bernstein, Chapman, et al. (1992) study, only mean LOS was reported, so it is possible that a few outliers were responsible for the large differences observed. In general, most patients who have a shorter acute hospital LOS go home, while those who have a longer LOS are more likely to enter a rehabilitation unit (Andersen, Sharkey, Schwartz, et al., 1992). This raises a question of a potential bias (the "Will Rogers phenomenon") that, among patients who have similar admission GCS scores, those who are discharged early are likely to be healthier than those who are not.

Five studies have used multivariate analysis methods to identify factors associated with a long rehabilitation LOS (Andersen, Sharkey, Schwartz, et al., 1992; Cowen, Meythaler, DeVivo, et al., 1995; High, Hall, Rosenthal, et al., 1996; Rappaport, Herrero-Backe, Rappaport, et al., 1989; Spettell, Ellis, Ross, et al., 1991). Four of these studies found an association between early initiation of rehabilitation and a shorter rehabilitation LOS. In one study of 59 patients with severe injuries from a single rehabilitation facility, sex, GCS motor score, and acute LOS provided the best prediction of rehabilitation LOS, accounting for 34 percent of the total variance in a stepwise regression model (Spettell, Ellis, Ross, et al., 1991). After controlling for acute LOS, duration of coma was no longer an independent predictor of rehabilitation LOS. A study of 91 patients admitted to a single university inpatient rehabilitation center had similar findings (Cowen, Meythaler, DeVivo, et al., 1995). In that study--which included patients with mild, moderate, and severe injuries--admission FIM motor score and the length of the acute hospitalization were the strongest predictors of rehabilitation LOS.

A larger, prospective study of 525 patients in the TBI Model Systems sample confirmed some of these findings. The study by High, Hall, Rosenthal, et al. (1996) examined the association between initial severity of TBI, rehabilitation admission FIM, neurologic and extracranial medical complications, mechanism of injury, and payer source in predicting hospital LOS and charges. Patients' initial presentations ranged from mild to extremely severe and were generally skewed toward the severe end of the scale. Patients with lower GCS scores reached rehabilitation later, stayed longer, and generated higher charges than less severely injured patients. For patients within a given TBI severity, rehabilitation LOS and costs increased as acute hospitalization LOS and rehabilitation admission FIM increased. The effect of the admission FIM score was a very powerful predictor of rehabilitation LOS. For example, patients who had a GCS of 8 or less and an average FIM score 2.5 had an average rehabilitation LOS of 70 days, while patients who had a GCS of 8 or less and an average FIM score 4.5 had an average LOS of 21 days. In a regression analysis, acute care LOS was an independent predictor of rehabilitation LOS, along with GCS, average admission FIM, duration of coma, and medical complications. Together, these variables explained 50 percent of the variance in rehabilitation LOS. However, because the portion of explanatory power attributable to acute care LOS was not reported, it is not clear how strongly these results support the view that acute care LOS is a major determinant of rehabilitation LOS.

In this study (High, Hall, Rosenthal, et al., 1996), age did not correlate with rehabilitation LOS and was not included in the regression models. However, another study performed in the same group of patients found that older patients had much longer rehabilitation LOS than younger patients (89 days versus 55 days), even though acute LOS was not significantly different in the two groups (Cifu, Kreutzer, Marwitz, et al., 1996). These observations suggest that the relation between acute LOS, admission functional status, GCS scores, age, and other factors are complex. As a result, the relation between acute LOS and rehabilitation LOS may apply only within certain subgroups of patients. As mentioned earlier, the complexity of these relationships makes it difficult to interpret the results of Mackay and colleagues' (Mackay, Bernstein, Chapman, et al., 1992) observational comparative study. For example, inclusion of only a few severely injured, older patients with a low admission average FIM could substantially skew the results in one of the compared groups.

Does early rehabilitation reduce total costs (arc 7)?

No studies have examined the relationship between acute hospital LOS and the long-term costs of rehabilitation. In two of the studies discussed above (Cowen, Meythaler, DeVivo, et al., 1995; High, Hall, Rosenthal, et al., 1996), longer acute care LOS was associated with higher inpatient rehabilitation charges, but these studies did not examine direct costs or costs of care after discharge from the rehabilitation unit.

Does early intervention affect outcome (arcs 5 and 6)?

Only a few studies have examined the association between acute hospital LOS and short- or long-term outcomes of rehabilitation. Two of the studies discussed above addressed whether an acute hospital LOS predicts short- or long-term outcomes of rehabilitation. In one study, after adjustment for other risk factors, a longer acute hospital length of stay was mildly associated with a lower GOS score within 11 months of injury (Spettell, Ellis, Ross, et al., 1991). This association was statistically significant, but it was too small to be considered clinically important. In the other study (Cowen, Meythaler, DeVivo, et al., 1995), a longer acute hospitalization was associated with lower FIM motor and cognitive scores at the time of admission to rehabilitation. A longer acute hospitalization and a lower admission FIM motor score were also associated with lower discharge FIM scores.

Does early rehabilitation improve decisionmaking about transfer to a rehabilitation facility?

Hospital bed days in the acute trauma hospital are frequently used by patients waiting for transfer to an appropriate rehabilitation or chronic care facility (Andersen, Sharkey, Schwartz, et al., 1992). Apart from its effect on LOS and condition on admission or discharge from a rehabilitation unit, early involvement of a physiatrist as part of the acute-care trauma team might have other benefits. In theory, early involvement by a physiatrist could improve the process of initiating and supervising the application of rehabilitation techniques as the indications arise for such interventions. As mentioned earlier, in a large, regional, retrospective study, patients seen by a physiatrist in the acute-care setting were much more likely to be provided postacute rehabilitation than patients whose discharge planning team did not include a physiatrist (Wrigley, Yoels, Webb, et al., 1994). While it is not known whether this influence has a positive effect on outcome, it does suggest that formalized early neurological rehabilitation in the acute care setting might have the benefit of optimizing rehabilitative care after discharge.

Conclusions for Question 1

One small, retrospective, observational study from a single rehabilitation facility supports an association between the acute institution of formalized, multidisciplinary, physiatrist-driven TBI rehabilitation and decreased length of stay (acute hospital and acute rehabilitation) and some measures of short-term physiologic (noncognitive) patient outcomes (MacKay, Bernstein, Chapman, et al., 1992). The level of evidence is Class III. This study concerned patients with severe brain injury (GCS 3-8); there is no evidence from comparative studies for or against early rehabilitation in patients with mild or moderate injury.

Some indirect evidence also confirms that early rehabilitation is associated with a shorter inpatient rehabilitation LOS, but this association rests on important assumptions that have not been examined in prospective studies. Most important, the association of acute LOS with rehabilitation LOS and greater rehabilitation costs does not directly imply that shortening acute LOS will result in favorable changes in these outcomes. A common confounding variable in the studies reviewed in this section is the inability to control for the possible correlation between the velocity of recovery and the acute hospital LOS. Patients with TBI who have similar GCS scores on admission may recover at markedly different rates. If a patient evidencing rapid recovery reaches threshold for rehabilitation admission and continues to recover quickly thereafter, his or her acute rehabilitation LOS and total LOS days will be fewer than someone who reaches the same landmark at a slower rate. Because present indicators of TBI severity do not measure rate of recovery, this oversight might explain why the relation between acute LOS and rehabilitation LOS persists even after statistical control for severity of illness on admission.

Another finding in the studies reviewed in this section is that rehabilitation admission FIM and acute care LOS are strongly associated with rehabilitation LOS and outcome. This finding suggests that acute hospitalization LOS is not simply a proxy for injury severity or level of recovery on transfer to rehabilitation.

Future Research on Question 1

In essence, this question addresses the efficacy of starting formal rehabilitation efforts very early during the acute-care stay at the trauma center as opposed to "filling in" until the patient is transferred to a rehabilitation program. Certain therapeutic modalities such as physical therapy are generally felt to be properly started soon after admission because of the known rapidity with which complications such as contractures begin. Although the details of the proper techniques, timing, and intensity of such treatment remain to be determined, it is unlikely that a control group of patients that would receive no acute physical therapy could be ethically formed. Although the indications for early application of other rehabilitation-oriented therapeutic modalities are less clear, similar ethical constraints will likely prevent the development of pure control groups for any specific discipline.

The ability to study the efficacy of a formalized program, however, is not subject to such constraints at the present time. The concept of the acute initiation of formal rehabilitation should be defined as an attempt to begin rehabilitation independently of the patient's location or other extraneous constraints such as medical complications, bed availability, and so forth. Such a formalized system is an attempt to "blur the line" between the stay at the trauma center and the time at a rehabilitation center. It would attempt to divorce the treatment from the milieu so that the patient's needs would drive the treatment.

As such, the integration of such a formalized program into an acute care center's operating procedures could be effected in a prospectively randomized fashion without ethical constraints. Since such rehabilitation efforts properly come under the aegis of a physiatrist, the primary independent variable would be the involvement of a physiatrist overseeing explicit formalized application of rehabilitation techniques to the "experimental" group as compared with continuation of the status quo in the "control group." The dependent variables would be acute care and rehabilitation LOS, outcome at time of discharge from acute care (admission to inpatient rehabilitation), outcome at discharge from rehabilitation, and cost-effectiveness of resource utilization.

For such an investigation to work, patients would have to be classified into working categories at a very early stage so that formalized and standardized rehabilitation protocols designed to meet their needs could be applied. If every patient were to be treated differently, it would not be possible to control for the resulting confounding of treatment variables with the independent variable. On the other hand, since different patients need a different array of therapeutic modalities (differing in terms of treatments, timing, and intensity), managing all patients in the same fashion would not be proper. Therefore, if the research is to be useful, such issues must be addressed prior to onset of the investigation.

It also would be necessary to strictly define the applied therapies, since these would be confounding variables in the analysis. Issues such as timing, intensity, modalities, therapist training, milieu, and so forth would have to be standardized within and between treatment groups. This will be especially critical if multiple centers are to be included in the study and combined in the data analysis.

Such a study would not address which modalities should be applied at what point during the acute care stage. These are separate questions addressing the efficacy of rehabilitation modalities in general. The suggested investigation would, however, address the present, seemingly artificial dependence of the initiation of formal rehabilitation on extraneous variables which commonly occur during the early postinjury period.

Question 2: Does the intensity of inpatient interdisciplinary rehabilitation affect long-term outcomes?

After discharge from an acute care hospital, many people with TBI are admitted to an inpatient facility for intense multidisciplinary rehabilitation. It is widely acknowledged that the evidence supporting the effectiveness of inpatient rehabilitation is weak. A recent review identified eight studies published between 1984 and 1994 on the benefits of inpatient rehabilitation immediately or soon after discharge from an acute care facility (not including studies of "early" rehabilitation discussed in the preceding section) (Hall and Cope, 1995). Of the eight studies, three had control groups (Aronow, 1987; Hall, Mann, High, et al., 1996; Morgan, 1988). Only one study (Aronow, 1987) used a control group that did not undergo inpatient rehabilitation. Two studies (Blackerby, 1990; McLaughlin and Peters, 1993) compared patients who underwent inpatient rehabilitation with those who underwent inpatient rehabilitation plus an additional intervention. Of the four uncontrolled studies (Blackerby, 1990; Heinemann, Sahgal, Cichowski, et al., 1990; McLaughlin and Peters, 1993; Spivack, Spettell, Ellis, et al., 1992), two (Heinemann, Sahgal, Cichowski, et al., 1990; McLaughlin and Peters, 1993) compared measures of patients' function before and after rehabilitation, and two (Blackerby, 1990; Spivack, Spettell, Ellis, et al., 1992) examined the relationship between the intensity of rehabilitation services and outcomes.

A large number of older uncontrolled case series demonstrate that patients who participate in a comprehensive, multidisciplinary rehabilitation program after TBI improve on a variety of measures, including independence in ADLs (Cope and Hall, 1982), language skills (Basso, Capitano, and Vignolo, 1979; David, Enderby, and Bainton, 1982; Lomas and Kertesz, 1978; Sarno, 1976), vocational functioning (Dresser, Meirowsky, Weiss, et al., 1973), and neuropsychological functioning and emotional adjustment (Pazzaglia, Frank, Frank, et al., 1975). The methodologic limitations of these studies have been reviewed elsewhere (High, Boake, Lehmkuhl, et al., 1995).

Do these observational studies provide sufficient evidence that inpatient rehabilitation is an effective intervention? Because they are uncontrolled, these studies cannot prove that the improvements observed would not have occurred anyway in the natural course of recovery from injury. Older series of untreated survivors of TBI strongly suggest that avoidable complications occur frequently among candidates for rehabilitation who are not admitted to an inpatient rehabilitation unit following discharge from an acute care hospital. A study performed in 1969, for example, followed 102 people with TBI whose average length of coma was 3 weeks and whose entry into rehabilitation was delayed an average of 20 months postinjury (Rusk, Block, and Lowman, 1969). These individuals exhibited 30 frozen shoulders, 40 major decubitus ulcers, and approximately 200 other major joint deformities. Rehabilitation efforts in these patients produced significant reversals of these deficits. As the authors argued, however, it is likely that these complications could have been prevented by appropriate admission to a rehabilitation unit following discharge from the hospital.

While it is widely accepted that "doing nothing" is neither a reasonable nor ethical option, many questions remain about the effectiveness and cost of inpatient rehabilitation. How does inpatient rehabilitation compare with modern alternatives, such as outpatient rehabilitation or rehabilitation in a skilled nursing facility? Which components of multidisciplinary rehabilitation are actually responsible for the observed effects? What are the characteristics of the patients who have better results with the application of intensive, interdisciplinary rehabilitation? Does the intensity of rehabilitation services affect long-term outcomes? When should a course of inpatient rehabilitation end?

Challenges in Assessing the Effectiveness of Inpatient Rehabilitation

A precise knowledge of the natural, untreated prognosis of brain injury could reduce uncertainty about the effectiveness of inpatient rehabilitation, but such knowledge is lacking. Because experimental trials of inpatient rehabilitation are unlikely to be performed, investigators have relied on statistical methods to adjust for differences in the baseline characteristics between the groups of patients compared in studies. These groups might be patients who received different intensities of rehabilitation services, received rehabilitation services relatively early or late, or did not receive rehabilitation in the usual course of care. The validity of these methods depends in large part on the predictive ability of the risk factors measured in these studies.

As discussed below, the likelihood of a good outcome depends on many patient characteristics. For this reason, it is impossible to interpret studies that fail to describe the baseline characteristics of the sample under study. In such studies, it is not clear whether the results were due to the interventions under study or to unreported selection factors. Two extremes characterize these studies with respect to the description of populations and samples. On one hand, it is common to have a sample described as "patients who were considered ready for (the intervention) by their occupational therapists" or "consecutive referrals to a vocational rehabilitation program who were considered employable under the right circumstances." On the other hand, the inclusion criteria for the sample may be a lengthy list of narrow parameters, including scores falling within a specific range on a series of neuropsychological tests. In one case, there may be no description of the patients. In the other, the description may be so specific that the results do not apply to the greater proportion of patients.

The nature of rehabilitation makes it difficult to evaluate its effectiveness. Multidisciplinary rehabilitation is a complex intervention. Even in studies that provide evidence that patients undergoing rehabilitation improved, it usually is not possible to determine which specific components of rehabilitation are effective. In general, little description of the precise components of multidisciplinary rehabilitation programs is available. Some studies use the number of hours of performance of individual treatment modalities (e.g., physical therapy, occupational therapy, speech therapy, etc.) as a measure of the intensity of rehabilitation. However, additional hours of specific treatments may be provided to patients who enter rehabilitation with more severe deficits. In addition, their control for the confounding variables that they collected would have been considerably strengthened by the use of multivariate statistical methods such as regression analysis. Even without this confounding, an aggregate measure like time spent with the patient cannot capture the social factors and relationships that can be important components of the therapeutic process.

At present there is no reliable method to measure the effect of exposure to the milieu of the rehabilitation program--the interactions between patients and other patients, nurses, therapists, and physiatrists during the course of an inpatient TBI rehabilitation stay--or to separate their effects from the content of the actual therapy provided. Such information may be critical when attempting to determine whether an inpatient rehabilitation unit or a skilled nursing facility may be interchangeable for a given patient.

Most studies do not provide even descriptive information about the components of rehabilitation and the content of specific interventions. In these studies, rehabilitation is somewhat of a black box--it is defined, by default, as whatever happens between admission to and discharge from a rehabilitation unit. The lack of detail about what constitutes rehabilitation reduces the generalizability of each study's findings and makes it difficult to compare the results of different studies attempting to assess the effectiveness of rehabilitation.

In formulating a strategy for reviewing the literature, we focused on whether information was available to examine the actual mechanisms by which inpatient TBI rehabilitation affects outcomes. Specifically, we sought to examine whether the results of rehabilitation vary according to (1) whether the intervention was directed and managed by a physiatrist and (2) the number, kinds, and frequency of methods applied. Secondarily, we sought to examine which factors predict a good outcome and how these factors may be used in decisions about how and when patients might benefit from inpatient rehabilitation.

The population for this question consists of people who sustained TBI between the ages of 18 and 65 years whose injury severity warranted a trip to a hospital emergency department, transfer to acute care, and subsequent transfer to inpatient rehabilitation. We also intended to focus predominantly on studies that included or measured the following patient characteristics:

  • Age.

  • Glasgow Coma Scale score.

  • Severity of injury.

  • Multiple injuries.

  • Premorbid data.

  • Mechanism of injury (kind of trauma).

  • Intracranial diagnosis.

  • Functional status.

Finally, studies had to report one or more of the following outcome measures:

  • Length of stay in a rehabilitation facility.

  • Immediate care costs and long-term financial burden.

  • Health status at discharge from inpatient rehabilitation.

  • Long-term measure of impairment.

  • Long-term measure of disability.

  • Independence, relationships, family life, satisfaction.

Of the 87 papers included for review of questions 1 and 2 (see Figure 3), 57 had some relevance to question 2. Of these, 10 primarily addressed predictors of outcome, 22 were uncontrolled followup studies of inpatient rehabilitation, and 20 examined the usefulness or validity of various measures of outcomes. Five studies, which were controlled or quasiexperimental studies that addressed the effectiveness or intensity of inpatient rehabilitation, are discussed in detail in the following sections.

How effective is acute inpatient TBI rehabilitation in general?

Before addressing whether the intensity of inpatient TBI rehabilitation is associated with improved outcome, we examined the more general question of the effectiveness of TBI rehabilitation itself. A large number of uncontrolled case series show that people with brain injuries generally improve by the time of discharge from the acute inpatient rehabilitation facility (Ashley, Persel, and Krych, 1993; Basso, Capitani, and Vignolo, 1979; Ben-Yishay, Silver, Piasetsky, et al., 1987; Cope, Cole, Hall, et al., 1991; Cope and Hall, 1982; David, Enderby, and Bainton, 1982; Dresser, Meirwosky, Weiss, et al., 1973; Eames and Wood, 1985; Evans and Ruff, 1992; Johnston, 1991; Jones and Evans, 1992; Lomas and Kertesz, 1978; Malec, Smigielski, DePompolo, et al., 1993; 1Mills, Nesbeda, Katz, et al., 1992; Panikoff, 1983; Pazzaglia, Frank, Frank, et al., 1975; Prigatano, Fordyce, Zeiner, et al., 1984; Sarno, 1976; Scherzer, 1986; Tuel, Presty, Meythaler, et al., 1992). Because of imperfect knowledge about the natural history of TBI and the nearly complete absence of data about the results of alternative methods of rehabilitation after discharge from the acute care hospital, these Class III studies provide only weak evidence that inpatient rehabilitation is effective. Comparing these studies and aggregating their results into a systematic examination of results was not possible because data were too incomplete to discern the relationship between types of populations or interventions and outcomes.

One quasiexperimental study used an unmatched control group to assess the effectiveness of acute inpatient TBI rehabilitation (Aronow, 1987). Sixty-eight patients were selected from 107 consecutively discharged patients treated at a single inpatient brain injury rehabilitation center. Their long-term outcomes were compared with those of 61 patients selected from 1,400 cases consecutively entered into an epidemiologic database of TBI inpatients at a neurosurgical unit in an area of the country with no comprehensive rehabilitation available for severe TBI. These two groups were termed "rehabilitation" and "nonrehabilitation," respectively. The selection criteria were TBI (> 1 hour of unconsciousness and > 24 hours of altered consciousness), age at injury between 5 and 80, acute hospital LOS > 15 days, and not comatose at the time of acute hospital discharge.

Measures of TBI severity in the Aronow (1987) study were PTA, acute hospital LOS, presence or absence of open brain injury, and number of skull fractures. Age, sex, race, and years postinjury were measured as confounding variables. TBI severity and the other potentially confounding variables were controlled for by using regression analysis, entering the confounding factors into the model prior to adding the rehabilitation versus no rehabilitation variable. The outcome measure was a 13-variable measure that included vocational status; living arrangement; number of recent inpatient treatment episodes; number of recent outpatient episodes; hours of daytime care required; functional status in self-care, mobility, and residential skills; number of home and outside social contacts; and number of physical, cognitive, and emotional symptoms. This standardized outcome measurement was developed unique to this study and has not been otherwise tested. Outcome data were obtained via telephone interview with the person with TBI or a caregiver/relative during a set study period not indexed to time after injury or rehabilitation. Chi square analysis was used to examine differences in PTA between groups, and linear multiple regression modeling was used to control for confounding variables in determining the relationship between rehabilitation and outcome.

At baseline, the rehabilitation and nonrehabilitation groups differed significantly in PTA, the major index of TBI severity used in the study (Aronow, 1987). Seventy percent of the rehabilitation group had PTAs > 4 months, while 74 percent of the nonrehabilitation group had PTAs 1 month. The nonrehabilitation group also was less impaired in self-care activities and memory.

In a multiple regression model adjusting for age, sex, race, injury severity (PTA, acute hospital LOS, open brain injury, number of skull fractures), and years postinjury, rehabilitation was associated with a better long-term outcome (Aronow, 1987). The overall R2 value was 0.551, suggesting that about one-half of the variance in this group was accounted for by the nine predictors plus rehabilitation. Days in acute hospital, duration of posttraumatic amnesia, age at onset, sex, and whether rehabilitation was performed were statistically significant predictors of outcome. However, the correlation coefficient (Pearson r) for rehabilitation was only 0.159, suggesting that only about 3 percent of the variance was related to whether or not rehabilitation was done.

This study (Aronow, 1987) mildly supports the hypothesis that acute inpatient TBI rehabilitation improves outcome. The finding of a benefit despite worse initial severity in the rehabilitation group lends some credence to the results. The study has important weaknesses that have been enumerated by others (High, Boake, and Lehmkuhl, 1995). The obvious baseline differences between the two groups means that the attempt to identify a suitably comparable control population failed. While the statistical analysis was well done, this method of control works best when there is good reason to believe that the two groups being compared are similar. The differences also reflect the underlying problem that the subset of patients admitted to a rehabilitation unit are not representative of the population thought to benefit from it.

Because this was a retrospective study (Aronow, 1987), the authors were limited to information that had been recorded in the patients' charts or (in the case of the control group) data recorded in an epidemiologic study, although all records were abstracted using the same protocol and all followup interviews were conducted using an identical instrument and process. Data on the timing of followup (how long after injury, acute hospital discharge, and rehabilitation discharge the outcome data were collected) were not available. GCS data also were unavailable. Finally, the use of a proprietary outcome instrument prevents comparison of their data to other studies.

Is the intensity of acute inpatient TBI rehabilitation services related to outcome?

There are no prospective randomized controlled trials of different levels of intensity of acute rehabilitation. Four observational studies, three of which are retrospective, addressed the relationship between the intensity of rehabilitation services and outcomes for people with brain injury not due to stroke (Aronow, 1987; Blackerby, 1990; Heinemann, Hamilton, Linacre, et al., 1995; Spivack, Spettell, Ellis, et al., 1992) (see Evidence Table 2).

A retrospective multicenter study of 140 patients admitted between 1990 and 1991 to one of eight rehabilitation hospitals was the best of these studies (Heinemann, Hamilton, Linacre, et al., 1995). Although the study was retrospective, all of the participating hospitals were prospectively collecting data using the Uniform Data Set for Medical Rehabilitation (Granger, Hamilton, and Sherwin, 1986). Intensity of therapy was defined either by the number of billed hours of individual therapeutic modalities (physical therapy, occupational therapy, speech and language services, and psychological services) or by all services combined. The authors examined whether a higher level of services was associated with better motor and cognitive FIM scores, achievement of motor or cognitive potential ([D/C FIM-admit FIM]/[100-admit FIM]), and efficiency of change ([D/C FIM-admit FIM]) at the time of discharge.

An analysis of the interrelationships between intensity and severity of injury or other descriptors revealed that they were not independent. Intensity of treatment covaried with functional status at admission, patient demographics, and medical characteristics. This suggests that the functional status on admission is actually related to the therapy intensity the patient receives. It appears that the patients received more therapy if they were admitted with less cognitive function, had uninterrupted stays, had a longer delay to admission, were younger, and so forth.

Investigation of the relationship between intensity of therapy and their (Heinemann, Hamilton, Linacre, et al., 1995) various outcome measures (discharge motor and cognitive FIM scores, achievement of motor or cognitive potential, and efficiency of change) did not reveal any significant relationship for occupational, physical, or speech therapy intensities. There was also no significant intensity:outcome relationship for intensity of all therapies combined. Only the number of hours of psychologic work per day, usually delivered as cognitive therapy, were associated with any alterations in outcome. These alterations were improvements in discharge cognitive, FIM score, achieved potential gains in cognitive FIM score, and efficiency of cognitive recovery.

The major weaknesses of this paper (Heinemann, Hamilton, Linacre, et al., 1995) are the absence of a specific definition of TBI and lack of control for severity of injury as a confounding, predictive variable. It is unlikely that the admission FIM will cover all of the variance otherwise subsumed by GCS, PTA, and/or duration of unconsciousness (coma). There was no control over or description of differences in treatment between the involved hospitals. Also, the use of billing hours as the index of therapeutic intensity probably included time not spent directly in patient care. Finally, the authors only used one outcome measure (FIM), and there is no long-term followup. Despite these weaknesses, however, the use of prospective data collection and credible analytic techniques make this the most important paper to address the issue of the relationship between intensity of therapy and outcome. It is the only Class II study in this category.

A retrospective study (Spivack, Spettel, Ellis, et al., 1992) examined the influence on outcome measured at rehabilitation discharge of therapeutic intensity during the first treatment month and over the entire stay on 95 patients with TBI. The cohort consisted of patients with a complete set of records who had been admitted to a single inpatient rehabilitation unit between 1988 and 1990. A definition of TBI was not given. It was noted that not all patients were comatose on admission. LOS ranged from 20 to 412 days with a median of 58 days.

Intensity of treatment was calculated as hours of actual treatment performance measured in 15-minute intervals for PT, OT, ST, cognitive remediation, vocational services, neurophysiology, respiratory therapy, therapeutic recreation, and medical services. Intensity of treatment during the first month was the total hours of treatment during that month. Subjects were separated into high- and low-intensity groups based on the median split of treatment hours during the first month. The median was 76 hours with a range of 18 to 196 hours. Average daily intensity of treatment over the entire stay was calculated, and subjects were again classified into high- and low-intensity groups based on the median split. The median was 4 hours per day with a range of 1.4-12.25 hours. The authors (Spivack, Spettel, Ellis, et al., 1992) felt that the true time spent per weekday was probably about one-third higher, since these estimates did not take account of days when therapy could not be administered (passes, holidays, weekends, etc.).

GCS was measured within 24 hours of admission to the trauma hospital. Head AIS score, duration of coma, severity of extracranial injuries (highest non-head AIS), and time since TBI were also measured. The statistical method used to control for these confounding variables was unclear.

The independent variables were intensity of treatment during the first month of rehabilitation, average daily intensity of treatment over the entire LOS, and LOS. All of these independent variables were made binary using the median split method as described above.

The dependent variables were outcome measures. RLA scores were measured on admission and discharge. In addition, therapy-specific outcomes on admission and at discharge were assessed using a seven-point functional status scale developed by clinicians within each rehabilitation discipline. A principal components analysis was used with a varimax rotation conducted on the matrix of correlations among functional scale scores at admission to group the scores on various axes. This resulted in grouping along axes of physical performance, higher-level cognitive skills, and cognitively mediated physical skills. In addition, patients were rated on their RLA scores on admission and discharge.

The statistical methods for assessing the relationships between the independent and dependent variables were analyses of variance and covariance controlling for multiple comparisons.

Analysis of covariants (ANCOVA) with repeated measures analysis was used to investigate treatment intensity and LOS on the dependent variables of admission and discharge scores on physical performance, higher level cognitive skills, cognitively mediated physical skills, and RLA level. In this analysis, LOS and intensity of treatment during the first month of rehabilitation and LOS and average daily intensity of treatment over the entire LOS were separately analyzed.

LOS significantly influenced outcome across all outcome groups. With respect to either intensity of treatment during the first month of rehabilitation or average daily intensity of treatment over the entire LOS, the only statistically significant relationship was between discharge RLA and 1-month treatment intensity. Spivak, Spettel, Ellis, and colleagues (1992) found a borderline nonsignificant relationship (p=0.06) between higher level cognitive skills and average daily treatment intensity. They also found a borderline nonsignificant relationship (p=0.07) for the triple interaction of RLA, LOS, and average daily treatment intensity. Based on this borderline relationship, the authors performed univariate ANOVA analysis on this interaction. This revealed a significant effect of high-intensity treatment during the entire stay on RLA scores on patients with longer stays. This relationship did not hold for patients with short lengths of stay. ANOVA analyses of age and LOS as confounding variables suggested that these variables could not explain the correlation.

There are a number of weaknesses in the paper by Spivak, Spettel, Ellis, and colleagues (1992). Because a precise definition of TBI was not provided, it is difficult to determine the parent population. Additionally, the focus of the analyses was on outcome measures that were derived in the unit and were, therefore, of unestablished validity and reliability. The major weaknesses in this study, however, are the use of the median split method to dichotomize the independent variables and the lack of powerful multivariate statistical methods.

In this case, the median split method is a dichotomizing method of convenience and does not necessarily reflect any underlying physiologic basis. The distribution of intensity times may be influenced by confounding influences of various origins, including brain and extracranial injury characteristics, patient personality, payer characteristics, and so forth. One method to force independent variables into binary distributions would be to determine split thresholds recursively in terms of their influence on outcome. Alternatively, intensity of treatment could have been analyzed during the first month of rehabilitation and average daily intensity of treatment over the entire LOS as continuous variables. The use of the median split method in dividing independent variables might have increased the likelihood of a type II error.

The other major weakness in the paper by Spivak, Spettel, Ellis, and colleagues (1992) is the lack of powerful, multivariate control for confounding variables. As was demonstrated (Heinemann, Hamilton, Linacre, et al., 1995), it is not proper to assume independence between intensity of therapy and severity of injury or other patient descriptors. The analysis would have been considerably strengthened by using regression-type analysis.

In the analysis of results, several inferences were made from the nonsignificant but borderline interactions between higher level cognitive skills and average daily treatment intensity (p=0.06) and the triple interaction of RLA, LOS, and average daily treatment intensity (p=0.07). Based on the latter borderline relationship, a significant effect was found of intensity of treatment during the entire stay on RLA scores on patients with long LOSs. Based on this interaction, suggestions were made on managing the intensity of treatment for patients with more severe injuries. However, the original interaction that inspired these suggestions was not significant (p=.07); consequently, the value of the suggestions is not substantial.

In one retrospective study (Blackerby, 1990), the influence on brain injury outcome of a change in mean daily therapeutic intensity that accompanied a major programmatic change at the study institution was investigated. The study took place at two commercial inpatient head injury rehabilitation provider units run by Rebound, Inc., a commercial provider of head injury rehabilitation services. The charts of all 149 patients with brain injury in the program between 1986 and 1988 were evaluated; 97 percent of the patients were admitted with a diagnosis of TBI. There was no description of TBI provided. Patients were either in a coma treatment program or an acute treatment program. For the prechange group, 55 percent were in the coma treatment program (54 of 98 patients), whereas only 27 percent of patients in the postchange group were in the coma treatment program (14 of 51 patients).

There was no precise measure of TBI severity. Confounding variables quoted in this study included age, level of function on admission, and length of time postinjury as measured on admission. The measure of function on admission was not specified. It was reported that the two groups did not differ with respect to these variables, although the method of handling them as confounding variables is not stated and the raw data are not provided.

The independent variable was intensity of therapy measured as mean number of daily therapy hours for all types of therapy combined. The two groups were formed in 1986 when the rehabilitation provider units altered the structure of their rehabilitation service delivery system. At this time, the intensity of inpatient rehabilitation was increased from an average of 5.5 hours per day to an average of 8 hours per day.

The dependent variable was inpatient rehabilitation LOS. The relationship between the independent and dependent variables was analyzed using t statistics, separately analyzing the coma treatment and acute treatment groups.

The results demonstrated a large change in average length of stay in both the coma and acute treatment programs following the programmatic changes. The variability in the LOS also decreased after the programmatic change. The only statistical examination was a t-test between pre- and postchange LOS for both the coma treatment program and the acute treatment program. Both of these changes were statistically significant as tested.

The differences between these groups in terms of cost was evaluated. The average daily cost for the rehabilitation programs was $785 per day with $350 representing the fixed costs. For the patients in the coma treatment program, the average savings would be $16,950 per patient. For the patients in the acute treatment program, the average savings would be $18,504. It was noted that such cost savings, as well as the decreased variability in LOS that appeared to accompany the change in mean daily therapeutic intensity, would be of use to insurance carriers in predicting and controlling costs.

There are a number of weaknesses in the paper by Blackerby (1990). A strict definition of TBI was not provided, making it difficult to determine the parent population. In addition, there was a lack of control for severity of TBI or other confounding variables. No data on these variables were provided.

The major weakness, however, was the lack of statistical controls for a number of potentially significant confounding variables that are intrinsic to this experimental design. It appears there were major changes in this rehabilitation delivery system that accompanied the increase in mean daily therapy intensity. The paradigm change was described as a change to a "naturalistic activity, total therapeutic day model" that apparently involved adaptations of those activities of interest to the individual before head injury. It was suggested that implementation of internal case management was part of the new system and that "senior clinical staff were added to the programs in the roles of clinical consultants and case managers, which increased staff experience and personnel." The occurrence of programmatic changes of such magnitude will, almost by definition, alter patient management in ways outside of those resulting from the increase in mean daily therapy intensity. If all of these changes could be described and quantified, their confounding influences could be addressed using multivariate statistics. In the absence of these data and such statistical analyses, it is difficult to interpret the results of this report.

Conclusions for Question 2

Based on the current literature, there appears to be little evidence that therapeutic intensity, measured as hours of treatment, is related to the beneficial effects of acute, inpatient TBI rehabilitation when the analysis controls for confounding variables. The only Class II study (Heinemann, Hamilton, Linacre, et al., 1995) found no correlation between intensity of individual or grouped therapeutic interventions and outcome. The second study found statistically significant correlations only for discharge RLA and 1-month treatment intensity (Spivack, Spettell, Ellis, et al., 1992). Nonsignificant trends were reported toward associations between higher level cognitive skills and average daily treatment intensity and for a triple interaction of RLA, LOS, and average daily treatment intensity, but the interpretation of these trends is unclear in the absence of statistical significance or other supporting evidence. The third report (Blackerby, 1990) appears to have been so highly confounded by uncontrolled variables as to render questionable any comparative interpretation of findings.

There are a number of possible reasons why various intensities of rehabilitation do not appear to correlate with functional improvements. First, the effect of specific comorbidities was underinvestigated in these papers. Second, there is a lack of long-term followup in all three studies. Third, these studies did not examine the quality of treatments or the reasons the various therapies were applied.

Another potential explanation for the demonstrated lack of correlation between therapeutic intensity and outcome is that all patients were receiving enough therapy and that added hours did not make a difference. Similarly, the ranges of intensities of treatment (lack of treatment variability) may have been too limited to show differential effect. As Heinemann, Hamilton, Linacre, and others (1995) noted, the Health Care Financing Administration (HCFA) mandated 3 hours per day of therapy for each patient starting in 1983. The legislation may have decreased practice variation that, prior to the regulations, might have been wide enough to affect patient outcomes. Future studies should either consider suspending such constraints or including the influence of such mandated decreases in variation in therapeutic effort into the power calculations used to determine the minimal size of their patient populations.

Overall, however, it also is debatable whether hours of applied therapy is the proper index for therapeutic intensity. The impact of individual therapeutic disciplines may not be independent or even separable, and the time spent in each might not be the best index of their intensity.

The use of hours of applied therapy as the index for therapeutic intensity also raises the question of how to measure the "milieu effect" of comprehensive rehabilitation. The potential contributions to recovery that might arise from formal and/or informal patient-patient, patient-nurse, patient-therapist, and patient-TBI rehabilitation environments have not been addressed in any study to date. Particularly in units devoted to TBI, such a milieu effect should be taken into account in attempting to determine the mechanism of efficacy of the present rehabilitation efforts. This is particularly relevant to such questions as whether delivery of rehabilitation services to a similar group in a setting outside of a formal inpatient rehabilitation unit (i.e., a less expensive setting) is an equally efficacious and, therefore, acceptable alternative method of care delivery.

Future Research on Question 2

Future research into the question of intensity of inpatient rehabilitation must deal specifically with the limitations highlighted in the present body of literature. These deal specifically with the way the question has been asked and generally with the details of describing the patient population and the therapies applied.

The present unidimensional definition of intensity as hours of application appears to be neither an appropriate definition of intensity nor an adequate descriptor of the therapies. In order to examine the importance of hours of application, there must be a description of and control for the other aspects that make up each therapy. These include modalities used, therapist training, interactions between therapeutic disciplines, and so forth, as well as the milieu in which the therapies are delivered. For instance, it is questionable if it is valid to compare two separate physical therapy sessions solely in terms of time spent without addressing what is done within those sessions, who performs the therapies, which aspects of other treatment modalities (for example, cognitive therapy) might be imbedded, etc. Such confounding variables either need to be standardized (preferable) or described in a fashion amenable to subsequent statistical control.

It also is necessary to better describe the patient population being treated. It is highly unlikely that all people with TBI will receive optimal benefit from the same general therapeutic approach. It is critical that the types and magnitudes of impairments resulting from the TBI be described for the patient population, including both the severity of injury and the resultant degrees of physical and cognitive dysfunction. If adequate descriptions are provided, it will be possible to determine the interaction of the various facets of the individual treatment modalities with the types of impairment demonstrated by the people being studied. In addition, it will facilitate subsequent focused studies addressing matching treatment protocols to patient subtypes.

If treatments can be standardized and the patient population can be adequately described, it is possible that RCTs could be performed addressing hours of therapy as the independent variable and outcome as the dependent variable. With the proper standardization, the influence of general milieu also could be addressed by adding it as a second independent variable. Such investigations, if performed in fashions that are replicable and comparable between studies, should prove extremely valuable in furthering our understanding of optimizing types and intensities of treatments for people with specific, defined levels of TBI-induced impairments.

Question 3: Does the application of compensatory cognitive rehabilitation enhance outcomes for people who sustain TBI?

TBI-induced cognitive dysfunction manifests in a spectrum of changes in memory, language, concentration, physical problems, and various behavioral disorders. Several longitudinal studies serve to characterize the nature and extent of cognitive problems following TBI. In a study of United States servicemen discharged for medical and behavioral TBI sequelae (n = 2,243 of total discharge population of 1,879,724), 80 percent were discharged with mild dysfunction, 8 percent with moderate TBI, and 12 percent with severe TBI on the Abbreviated Injury Score for head injury (Ommaya, Dannenberg, Ommaya, et al., 1996). Servicemen who had mild TBI were 1.8 times as likely as other servicemen to be discharged because of behavioral problems. They also were 2.6 times as likely to be discharged for drug and alcohol problems and 2.7 times as likely to be discharged for criminal activities compared with other servicemen. The relative risks of discharge for medical reasons ranged from 7.5 for servicemen with mild TBI to 40.4 for servicemen with server TBI. Longitudinal studies in Sweden (Schalen and Nordstrom, 1994) and Scotland (Brooks, McKinley, Symington, et al., 1987) found outcomes in TBI victims at 5 and 8 years and 7 years postinjury, respectively, that included persistent neurophysical pathology, language disorders, dependence on relatives, and myriad mental or behavioral problems, such as hostility, childish behavior, anger, distraction, and fatigue.

Seeking a theoretical foundation for development of effective interventions, scientists and clinicians have generated a number of models of cognition. These models differ by discipline but generally include the concept that cognition operates as an integrated system consisting of performance fields and various functions within these fields (Goldstein, 1995). The fields include attention, memory and learning, thinking or mental organization, affect and expression, and executive functions. Brain injury will affect overall performance and, depending on the nature and severity of the injury, may have differential effects on performance within these fields. Various strategies are used to help improve damaged intellectual, perceptual, psychomotor, and behavioral skills (Wehman, West, Fry, et al., 1989). These systems of interventions are designed to increase daily functional abilities by improving or augmenting deficits in processing and interpreting information (Coelho, DeRuyter, and Stein, 1996).

One general distinction that serves to classify therapeutic strategies is that between restorative and compensatory cognitive rehabilitation. Restorative cognitive rehabilitation (RCR) is based on the theory that repetitive exercise can restore lost functions (Coelho, DeRuyter, and Stein, 1996). RCR targets internal cognitive processes, with the goal of generalizing improvements to real-world environments. Techniques used in RCR include auditory, visual, and verbal stimulation and practice, number manipulation, computer-assisted stimulation and practice, performance feedback, reinforcement, video feedback, and meta-cognitive procedures such as behavior modification. Refinements in RCR methods involve extensive clinical evaluation to identify specific cognitive processes which are damaged and individual remediation protocols targeting those processes (Sohlberg and Mateer, 1989).

Compensatory cognitive rehabilitation (CCR) strives to develop external, prosthetic assistance for dysfunctions (Wehman, Kreutzer, Sale, et al., 1989). It does not rely on the ability to generalize learning or the restoration of lost abilities. CCR uses visual cues, written instructions, memory notebooks, watches, beepers, computers, or other electronic devices to trigger behavior. Therapists assist by simplifying complex tasks, capturing the patient's attention, reducing distractions, and teaching self-monitoring procedures. CCR also includes jingles, mnemonics, verbal rehearsal, and paraphrasing. The concept of CCR has been expanded to include modification of the behavior of family members, teachers, and other support people present in the life of a person with TBI (Ylvisaker and Feeney, 1996). The adapted behavior of communication partners combines with the technical assistance of prosthetic devices and external cues to provide an environment of supported cognition.

RCR and CCR are not mutually exclusive and are commonly mixed in therapeutic programs for TBI. Restorative training is often enhanced by cues, mnemonics, and other compensatory prosthetics. In the absence of evidence for the differential effectiveness of these interventions, clinicians are compelled to combine and provide protocols according to their experience.

Some insurance programs do not pay for cognitive therapy as a stand-alone treatment or as a clearly defined component of a treatment protocol. Therefore, RCR and CCR techniques may be components of a rehabilitation program that is more traditionally defined and thus eligible for payer reimbursement. For example, many inpatient and TBI day treatment programs use speech and language pathology treatment principles to provide cognitive remediation within a broad and more widely accepted program context of occupational therapy, physical therapy, speech therapy, community integration, and vocational rehabilitation. As a consequence, it is difficult to distinguish the effect of the cognitive strategy from that of the other interventions being applied.

Experts in cognitive rehabilitation have developed specific measures for many of the functions impaired by brain injury. These measures, frequently used by researchers in published studies, are also used by clinicians to diagnose deficits and make decisions about treatment planning. Many also are used to test whether results in patients are consistent with various theories of cognition.

Table 6. Summary of results of intermediate measures of cognitive function (please see text for explanation)
Number of tests found to have a positive effect or associationNumber of tests done without a positive effect or associationProportion of positive effects found
Cognitive Domain and Associated TestsRCTs (a)Comparative studies (b)Correlational studies (c)RCTs (d)Comparative studies (e)Correlational studies (f)RCTs & Comparative a+b. a+b+d+eCorrelation Studies c. c+f
Attention and orientation
Digits011333.14.25
Mental Control00010000
Trails A & B0031110.75
PASAT012210.251.0
Test d200010000
Continuous Test of Attent.00100001.0
Divided Attention00010000
Ruff 2 & 700010000
Letter Cancellation00001000
Time Estimation00001000
Attention to Task0100001.00
Attention Rating Scale0100001.00
WMS Attent./Concentr.00000200
Digit Symbol0010110.50
Ruff-Light Trail00020000
Tactual Performance00101001.0
Choice Reaction Time0100001.00
Simple Reaction Time00001000
Vigilance00001000
Totals05912117.18.56
Memory
WMS General00000200
WMS Verbal00000200
WMS Visual00221001.0
WMS Delayed Recall0010010.5
WMS Memory Quotient0100001.00
WMS Logical Memory00232001.0
WMS Paired Associates00101001.0
Rivermead Beh. Mem. Test00010000
Everyday Memory Quest.00010000
Calif. Verb. Learn. Test00000100
Rey Complex Figure00111001.0
Rey Audit. Verb. Learn.00010000
Block Span Learning00010000
Benton Vis. Memory Test00010000
Taylor Complex Figure00011000
Buschke Select. Remind.00101001.0
Recalling Sentences1000001.00
Totals1181276.10.57
Verbal & Language
WAIS-R Information00000100
WAIS-R Vocabulary00101001.0
Language Competence1000001.00
Word Fluency00001200
Mill Hill Vocabulary00000100
Token Test00000100
Totals101025.33.17
Construction
Parquetry Block Design1000001.00
WAIS-R Block Design021100.671.0
Object Assembly00000100
Rey Complex Figure Copy00101001.0
Totals122111.60.67
Concept Formation & Reasoning
WAIS-R Similarities00001100
WAIS-R Picture Arrangem.00100001.0
WAIS-R Picture Complet.0100011.00
WAIS-R Arithmetic0110001.01.0
Making Inferences00010000
Raven's Progress. Matrices0100001.00
Category Test0010020.33
Wisconsin Card Sorting00001100
Comprehension00101001.0
Totals034135.43.44
Executive Functions & Motor Performance
WISC-R Mazes0010010.50
Austin Maze00001000
Hals. Reit. Finger Tapping00002100
Grooved Pegboard00100001.0
Grip Strength00000100
Totals0020330.44
Batteries & Global Tests
WAIS-R Full Scale I.Q.0010010.5
WAIS-R Verbal I.Q.0010210.5
WAIS-R Performance I.Q.013011.33.75
Russell Neur Av. Imp. Rat.00001000
San Diego Neuro. Test Bat.00010000
Wide Range Achiev. Test00000100
Hals. Reit. Impair. Index00100001.0
Totals016144.17.60
Miscellaneous & Clinic-Specific Tests
Adolescent Word Test A1000001.01.0
Adolescent Word Test B00010001.0
Adolescent Word Test C1000001.01.0
Adolescent Word Test D00010001.0
Picture Vocabulary Test1000001.01.0
Word Association Subtest1000001.01.0
Understanding Metaphors00010001.0
Peabody Picture Vocabulary00010001.0
Ambiguous Sentences1000001.01.0
Listening to Paragraphs00010001.0
Neale Analysis of Reading00001001.0
Pursuit Rotor00001001.0
Sentence Assembly00010001.0
Recreating Sentences00010001.0
Single Reaction Time00010001.0
Choice Reaction Time00010001.0
NYUMT Acq. Rec. Scaled1000001.01.0
NYUMT Acq. Rec. Stand.00010001.0
Memory Index Scaled1000001.01.0
Memory Index Standard1000001.01.0
VerPa1000001.01.0
VisPa1000001.01.0
TeachWare Screen. Module1000001.01.0
Name Writing00100001.0
Totals11011020.481.0
GRAND TOTALS141233373331.27.52

Note: Tests were placed into categories consistent with taxonomy provided by Lezak (1995)

Table 6 shows tests and scales commonly used in practice and the frequency of their use in studies of cognitive rehabilitation. Although practitioners agree the desired outcome of cognitive rehabilitation is improvement in daily function, many of the commonly used scales are intermediate measures rather than health outcomes. For example, the Paced Auditory Serial Attention Task, or PASAT (Gronwall, 1977) is a test of attention in which subjects are presented with a string of digits and are required to add each number to the one preceding. A cognitive rehabilitation study may identify attention as the primary dysfunction for a patient, apply an intervention designed to improve attention, and use the PASAT as a measure of improvement. The rehabilitation program at Auckland Hospital in New Zealand transitions clients from one phase to another when a specific score on the PASAT (mean time scores < 4 seconds) is achieved (Gronwall, 1996). This example raises important questions about published studies of cognitive rehabilitation. First, is the observed improvement on the PASAT greater than that of natural recovery or of other interventions? Related questions include: Can the improvement on the PASAT be attributed to the specific intervention selected for the study? Or, would general stimulation produce the same effect? Does the evidence justify the need for complex, sometimes expensive therapeutic techniques, or would simpler, less expensive techniques work as well?

Second, in this example, do high scores on the PASAT accurately predict whether the patient's attentional performances will function adequately in the context of work or social situations in which distraction and other demands are present? More generally, do the measures used to assess the effectiveness of cognitive rehabilitation predict improvement in real life function?

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3309_f3-5.jpg.

   Figure 5. Casual pathway for cognitive rehabilitation

Note: *PASAT=Paced Auditory Serial Additional Task
WAIS-R=Wechsler Adult Intelligence Scale - Revised
See Table 6 for measures of cognitive abilities.

The causal pathway we used to address these questions is shown in Figure 5. Arc 1 represents the direct effect of cognitive rehabilitation on health outcomes-outcomes that can be felt or experienced by the patient in daily life. A panel of technical experts identified the relevant health outcomes of cognitive rehabilitation for people with TBI (see Chapter 2, Methods, Topic Assessment and Refinement, earlier in this report). The panel, which included a psychologist, a neuropsychologist, and a cognitive rehabilitation therapist, listed the following outcomes:
  • Activities of daily living (ADLs).

  • Long-term measure of disability (restriction or, as the result of an impairment, inability to perform an activity in the manner or within the range considered normal for a human being).

  • Long-term measure of impairment (loss or abnormality of psychological, physiological, or anatomical structure or function).

  • Independence, relationships, family life, satisfaction.

  • Long-term financial burden.

In the context of a systematic review, "direct" evidence comes from comparative studies that examine the effects of cognitive rehabilitation on measures of these outcomes. Arc 2 represents the direct effect of cognitive rehabilitation on measures of employment such as return to work and job retention.

"Indirect" evidence refers to a causal chain that relies on intermediate measures. In Figure 5, the first link in this chain is between the intervention and intermediate measures of improvement (Arc 3); this link corresponds to the question, "Does cognitive rehabilitation improve scores on intermediate measures of cognitive function, such as the PASAT, WAIS-R, etc.?" The next links in the causal chain correspond to the question, "Do intermediate measures used to assess the effectiveness of cognitive rehabilitation predict improvement in real life function (Arc 4) and employment (Arc 5)?"

Of the 114 potential references identified by the literature search for inclusion in this section of the report, 53 met the predetermined eligibility criteria (see Table 5). Reference lists of reviewed articles and peers identified 20 additional articles, resulting in a total of 73 full-text articles that were retrieved and read. Of those, 41 were excluded: 3 were review articles, 5 were studies with fewer than 5 subjects, 1 was retrospective, and 25 studies were descriptive. Five studies measured independent or dependent variables outside the scope of this research question, and two studies compared clients who were referred for treatment with those referred for testing. While excluded as evidence about effectiveness, the descriptive and observational data from these research efforts provided a foundation for understanding and interpreting the evidence.

The remaining 32 articles were abstracted and are presented in the following categories:
  • 1

    Eleven randomized controlled trials:
    Five measuring relevant health outcomes (Evidence Table 3).
    Six measuring intermediate outcomes (Evidence Table 5).

  • 2

    Four comparative studies:
    One measuring employment outcomes (Evidence Table 4).
    Three measuring intermediate outcomes (Evidence Table 6).

  • 3

    Eight studies of the relationship between intermediate tests and employment (Evidence Table 7).

  • 4

    Nine observational studies:
    One measuring relevant health outcomes (Evidence Table 8).
    Eight measuring intermediate outcomes.

Direct Evidence

Does cognitive rehabilitation improve health outcomes (Arc 1)?

Five randomized controlled trials (Helffenstein and Wechsler,1982; Neistadt, 1992; Novack, Caldwell, Duke, et al., 1996; Ruff and Niemann, 1990; Schmitter-Edgecombe, Fahy, Whelan, et al., 1995) used measures of relevant health outcomes to compare the effects of specific forms of cognitive rehabilitation to other treatments (see Evidence Table 3). Two studies examined CCR, one examined RCR, and two used a combined program of RCR and CCR. Comparison groups were provided unstructured sessions, computer game sessions, and nontherapeutic attention. In one study (Neistadt, 1992) two specific restorative trainings were provided. Each group was trained in one of the skills and tested for both. Treatment time for four of the studies ranged from 10 to 20 hours; the fifth (Ruff and Niemann, 1990) provided 96 hours of treatment. Followup for one study (Schmitter-Edgecombe, Fahy, Whelan, et al., 1995) occurred at 6 months and for a second study (Helffenstein and Wechsler, 1982) at 1 month for six of the subjects; the other studies did not have followup testing.

As seen in Evidence Table 3, the studies varied in setting, populations, size, client chronicity, and measures of severity of injury. These trials involved 137 clients; 69 received the targeted treatments.

Measures used in these studies that approximated important health outcomes were the Functional Independence Measure (FIM) (Novack, Caldwell, Duke et al., 1996), Observed Everyday Memory Failures (EMFs) (Schmitter-Edgecombe, Fahy, Whelan et al., 1995), the Rabideau Kitchen Evaluation Revised (RKE-R) (Neistadt, 1992), the Katz Adjustment Scale (KAS) (Ruff and Niemann, 1990), and a variety of inventories designed to measure anxiety, communication, and relationships (Helffenstein and Wechsler, 1982). In addition, these studies used neuropsychological test batteries and other intermediate measures of cognitive function to evaluate treatment effect.

In two studies, treatment produced statistically significant effects on relevant outcome measures. In one study (Schmitter-Edgecombe, Fahy, Whelan, et al., 1995), individuals trained in the use of notebooks and equipped with wristwatch alarm cues had fewer EMFs than those who did not have the compensatory devices. However, the effect was not present at 6-month followup. In the second study (Helffenstein and Wechsler, 1982), clients who received compensatory training had better results than those given nontherapeutic attention on one variable from an anxiety scale and three variables from a communication scale, and they had better performance on the Interpersonal Relationship Rating Scale and Independent Observer Report Scale. Six scales were used in this study, and the number of variables per scale, as well as group means, were not provided.

In the other three studies described in Evidence Table 3, the cognitive rehabilitation intervention was not more effective than alternatives. The predominantly negative results of these small, Class I and II(a) trials may be mitigated by three important factors. First, in general both groups in these studies improved from pre- to posttreatment, producing no treatment effect in the statistical analysis. This raises questions about what is operating to cause general improvement, stimulation or spontaneous recovery, or both? In each study the comparison group received equal hours of some form of stimulation, some of which was therapy of an unstructured nature. Second, four of the five studies provided 20 hours or less of treatment time. With the pervasive and life-long cognitive deficits that result from TBI, results from interventions of such limited duration should not be generalized to more sustained interventions. Third, it is unclear whether the patients included in these studies are representative of patients who might undergo cognitive rehabilitation in current practice. Along with the small size of studies and the narrow range of interventions studied, the lack of information about the representativeness of included patients makes it difficult to apply the findings of these studies to cognitive rehabilitation practice generally.

Does cognitive rehabilitation improve employment outcomes (Arc 2)?
Randomized controlled trials

There is no direct evidence from randomized trials of the effect of cognitive rehabilitation on employment.

Comparative studies

One study (Prigatano, Fordyce, Zeiner et al., 1984) compared employment outcomes for clients of an intensive cognitive rehabilitation program (NRP) with those of people who were referred to the program but who did not participate (see Evidence Table 4). The intervention involved RCR and CCR in a coordinated multidisciplinary program. Participants were provided a minimum of 624 hours of treatment, 4 days a week, 6 hours a day, over 6 months. The treatment group consisted of patients who entered NRP between February, 1980 and August, 1982 and stayed in the program at least 6 months. Files for referrals to NRP during the same time period who did not enter the program were retrospectively evaluated to provide control group data. Followup took place approximately 3 months after the last client was discharged; consequently, followup varies from between 3 months to 33 months. Eighteen people received the treatment; 17 were the nonclient referrals. Chronicity for the control group was shorter (13.6 months) than for the treatment group (21.6 months). Severity was not specified.

Participants were evaluated with 13 neuropsychological tests, the Katz Adjustment Scale (KAS) relative scale, and a measure of employment. People who were gainfully employed, either part time or full time, or were actively engaged in a realistic school program were considered employed. There were treatment effects on 3 of the 13 neuropsychological tests. Client attrition resulted in a reduction of participants at the time of followup. Of 18 people in the treatment group, 9 were employed at followup (50 percent). Of 13 people in the control group, 5 were employed (38 percent). The statistical significance of this difference was not reported.

Because of the potential and unknown differences between treatment and control groups, interpretation of these results is difficult. The authors (Prigatano, Fordyce, Zeiner, et al., 1984) did not specify why clients in the control group, although referred to NRP, did not participate. It is possible that the same factor or factors that caused them not to participate in NRP operated to influence their employment outcomes (in either direction). This Class II(b) study does not provide evidence for or against the effect of cognitive rehabilitation on employment. However, it provides limited evidence of the effect of the intervention on some intermediate measures of cognitive function.

Indirect Evidence

Does cognitive rehabilitation improve performance on intermediate measures of cognitive function (Arc 3)?

Randomized controlled trials. Six randomized controlled trials (Kerner and Acker, 1985; Niemann, Ruff, and Baser, 1990; Ruff, Baser, Johnston, et al., 1989; Ryan and Ruff, 1988; Thomas-Stonell, Johnson, Schuller, et al., 1994; Twum and Parente, 1994) used a variety of neuropsychological tests and other intermediate measures to compare the effects of different forms of cognitive rehabilitation with each other and with other forms of therapy and stimulation (see Evidence Table 5). Three studies combined RCR and CCR techniques; the other three used RCR exclusively in the interventions. Duration of treatment ranged from a single training session to a total of 160 hours of intervention. Two studies (Kerner and Acker, 1985; Niemann, Ruff, and Baser, 1990) conducted followup testing at 2 weeks. The other studies did not involve followup of participants. The studies varied in setting, client populations, size, client chronicity, and measures of severity of injury. One hundred eighty-two clients were observed; 106 received the targeted treatments.

A number of individual tests of cognition, such as the PASAT, were used in the six RCTs. In addition, three of the studies also used a full battery of neuropsychological subtests, two of which used the San Diego Neuropsychological Test Battery (SDNTB). Three studies produced treatment effects. Outcomes for one (Thomas-Stonell, Johnson, Schuller, et al., 1994) were a computerized screening module and a neuropsychological battery. No followup testing was conducted. Outcomes for the second study (Twum and Parente, 1994) were number of words and colors recalled immediately after practicing mnemonic techniques with the words and colors. No followup testing was conducted. Outcomes for the third study (Kerner and Acker, 1985) were a Memory Index (MI) task and an Acquisition Recall (AR) task, measured in scaled and standard forms. The treatment group received CACR targeting memory retraining. A control group used computers to create graphics, and a second control group had no intervention. With three groups and two forms of measuring each of the two tests, 12 effects were possible. Treatment effects were produced on 5 of the 12 measures at posttreatment. Improvement by the treatment group was not maintained at 2 week followup; however, the two control groups did not receive a followup test, so group differences in the decline were not measured.

Two of the three studies for which there was no treatment effect (Ruff, Baser, Johnston, et al., 1989; Ryan and Ruff, 1988) compared equal amounts of structured cognitive rehabilitation programs with unstructured activities, providing the greatest number of treatment hours among the RCTs in this review. The third (Niemann, Ruff, and Baser, 1990) compared equal hours (36 total) of attention remediation with memory remediation. For all three studies, clients in both treatment and comparison groups improved from pre- to posttreatment. This result underscores the previous suggestion that more may be learned about treatment effects by comparing intervention with no intervention rather than comparing one form of intervention (i.e., structured) with another form (unstructured) in a design that provides equal amounts of time and stimulation. Also, this result suggests there may be a general effect of stimulation, perhaps interacting with spontaneous recovery, that exceeds the effect of the intervention.

To conclude, there is evidence from three small Class I trials that the restorative technique of practice, both with and without the aid of a computer, operates to improve short-term recall on laboratory tests of memory for people with TBI.

Comparative studies

Three studies with comparison groups to which participants were not randomly assigned used laboratory tests to evaluate the effects of cognitive rehabilitation on cognition (Batchelor, Shores, Marosszeky, et al., 1988; Gray, Robertson, Pentland, et al., 1992; Wood and Fussey, 1987) (see Evidence Table 6). All three used computers (CACR) to enhance the intervention. One (Gray, Robertson, Pentland, et al., 1992) compared the effect of CACR with that of recreational computing; the other three compared CACR with therapy that did not make use of computers. Treatment time ranged from 16 to 20 hours. Two studies (Gray, Robertson, Pentland, et al., 1992; Wood and Fussey, 1987) performed followup testing at 6 months and 20 days, respectively. Samples included both inpatients and outpatients; the populations from which they were drawn varied. These studies involved 95 people; 44 received the targeted interventions.

Measures used to evaluate treatment effect included tests developed by the clinic or research project as well as established neuropsychological tests such as the PASAT, WAIS-R, Taylor Figure, and Digit Symbol. Of 36 intermediate tests performed, 2 of the 3 studies produced treatment effects on 9 tests. Group means were not presented, preventing an assessment of the magnitude of improvement. As with the RCTs for this category, equal amounts of stimulation were provided treatment and control groups. Improvements from posttreatment to followup suggest the presence of spontaneous recovery. These small, Class II(b) studies provide limited evidence that CACR improves performance on laboratory tests of cognition for people with TBI.

Table 6 summarizes the results of the studies, reviewed above, that used laboratory tests of cognition to measure treatment effects. The first column lists all the laboratory-based tests that were used, within categories as defined by Lezak (1995): attention and orientation; memory, verbal, and language; construction; concept formation and reasoning; and executive functions and motor performance. Two additional categories are batteries and global tests, and miscellaneous and clinic-specific tests. Column (a) shows the number of RCTs in which cognitive rehabilitation had a statistically significant effect on the test listed for that row; column (b) presents the same information for comparative studies. Column (c) gives the number of correlational studies in which there was a significant correlation between the test and a health outcome or employment. Columns (d), (e), and (f) list numbers of studies for each test for which there was no effect or association. Column (g) is the proportion of times the test was used in controlled studies (RCTs and other comparative studies) that the intervention produced an effect on the test. Column (h) is the proportion of times the test was used in correlational studies that there was a positive correlation between the test and a health outcome or employment. Ninety-one different laboratory-based tests of cognition were used in 160 distinct evaluations in the studies presented in evidence tables for this research question. For RCTs, the research design most capable of providing evidence for effectiveness, there was an effect of treatment 14 of 51 times (27 percent). Other comparative studies produced a treatment effect 20 of 61 times (33 percent). For correlational studies, there was a significant association between intermediate tests and health outcomes or employment 33 of 64 times (52 percent). Thus, as the strength of evidence decreased, the effect increased. In addition, as the strength of research design decreased, the number of studies increased.

As discussed earlier, although the evidence is limited, there is some suggestion that certain cognitive rehabilitation methods improve performance on neuropsychological tests and other laboratory-based methods of evaluating cognitive function. The next question addresses the second link in the indirect path from intervention to relevant outcome.

Do intermediate measures of cognitive function associate with health outcomes (Arc 4) or employment (Arc 5)?

No studies meeting the criteria for this review reported an association between laboratory-based measures of cognitive function and health outcomes such as functional independence, ADLs, or measures of everyday memory.

Evidence Table 7 presents eight studies that measured the cognitive function of people with TBI using a variety of neuropsychological tests and also measured postinjury employment status or productivity and activity level (Brooks, McKinlay, Symington, et al., 1987; Cicerone, Smith, Ellmo, et al., 1996; Ezrachi, Ben-Yishay, Kay, et al., 1991; Fabiano and Crewe, 1995; Fraser, Dikmen, McLean, et al., 1988; Girard, Brown, Hashimoto, et al., 1996; Ip, Dornan, and Schentag, 1995; Najenson, Grosswasser, Mendelson, et al., 1980). Each used some correlation-based method to analyze the relationship between the laboratory tests and employment status. Although specific research methods varied, in general these studies retrospectively gathered hospital and inpatient rehabilitation chart data to establish test scores and then interviewed clients and/or relatives to establish employment status. Sample sizes ranged from 20 to 152 participants; a total of 724 people were observed. Chronicity and severity varied within and across samples.

In all, 123 tests of cognition were administered. Two studies (Ezrachi, Ben-Yishay, Kay et al., 1991; Girard, Brown, Hashimoto et al., 1996) used numeric scales to measure productivity from 1 (worst) to 10 and 6, respectively. Four studies (Brooks, McKinlay, Symington, et al., 1987; Cicerone, Smith, Ellmo, et al., 1996; Fraser, Dikmen, McLean, et al., 1988; Ip, Dornan, and Schentag, 1995) used dichotomous measures of return to work or former level of productive activity. Two (Fabiano and Crewe, 1995; Najenson, Grosswasser, Mendelson, et al., 1980) placed clients into five and four categories of employment, respectively. Methods of analysis included regression, t-tests, chi-square, Wilcoxon rank sum, discriminant analysis, and factor analysis.

About half of the time, clients with higher intermediate test scores had returned to work or productivity, either full or part time, but not necessarily to the pretrauma level. In one study that used a regression analysis (Girard, Brown, Hashimoto, et al., 1996), 9 of 28 test scores, combined with 3 demographic characteristics, accounted for 30 percent of the variance in outcome; 19 of the tests did not help explain the difference in employment outcomes. In another study (Fabiano and Crewe, 1995) intermediate test scores were used in a discriminant analysis to derive a formula for predicting employment status. With this method, high scores on tests accurately predicted full-time employment 62 percent of the time, and low scores on tests accurately predicted unemployment 67 percent of the time. These proportions indicate that, while there appears to be some relationship between intermediate measures of cognition and employment, the association is not strong.

Observational Research

Although research designs without control groups are limited, they can be a source of hypotheses which could be tested in controlled trial settings. This section highlights insights from studies with uncontrolled research designs identified in our literature search.

Nine observational studies of clients before and after cognitive rehabilitation fulfilled the criteria for inclusion in this review (Cicerone and Giacino, 1992; Deacon and Campbell, 1991; Glisky, Schacter, and Tulving, 1986; Goldstein, McCue, Turner, et al., 1988; Middleton, Lambert, and Seggar, 1991; Ponsford and Kinsella, 1988; Ruff, Mahaffey, Engel, et al., 1994; Scherzer, 1986; Wilson, Evans, Emslie, et al., 1997). One study used a measure of a relevant health outcome, everyday memory failures (EMFs), to evaluate treatment effect, and it is presented in Evidence Table 8 (Wilson, Evans, Emslie, et al., 1997).

The other eight studies either compared clients' performance from baseline phase to treatment phase, provided the same or similar treatments to different matched groups, or combined group and individual methods of measurement. In general, results indicate that for the selected clients treated in these clinical studies, one-on-one interaction with therapists in a rehabilitation environment is likely to improve individual performance on targeted laboratory tasks. Because the studies are not comparative, the improvement observed does not contribute to the body of evidence about the intervention being provided. However, the fact that clients do in fact improve gives rise to innovations in rehabilitation technology that may be useful to people with TBI and thus warrant further evaluation.

For example, in the study presented in Evidence Table 8 (Wilson, Evans, Emslie, et al., 1997) 15 clients were provided an electronic device, programmed to assist them in remembering to do routine daily tasks. Prior to the intervention, they were interviewed to identify targets for memory remediation unique and important to them. Thus the intervention was individually adapted. The score for everyday memory failures (EMFs) was the number of times a target was forgotten. EMFs were measured for 2 to 6 weeks during baseline. During the treatment phase, which lasted 12 weeks, each person in the study wore and used the device. The return-to-baseline phase was 3 weeks.

All participants had significant decreases in EMFs during treatment. During return-to-baseline, EMFs increased for 11 of the 15 participants; five increases were statistically significant. The results of this study suggest that the use of an electronic cueing device decreases EMFs for some people with TBI. These findings also contribute to the evidence for the link represented by Arc 1 of the causal pathway. The observational design of this study weakens its value as evidence of effectiveness. However, in considering that the nature of most of the interventions reviewed here are not individually adapted and on face value do not appear to be as pragmatic as an effective reminder device, this study is useful in that it generates a hypothesis about an intervention that may have the potential to prosthetically improve memory for a person with TBI.

Conclusions for Question 3

Very few controlled studies of cognitive rehabilitation have examined health outcomes or employment. Two small randomized controlled trials (Class I) and one observational study provide evidence of the direct effect of compensatory cognitive devices (notebooks, wristwatch alarms, programmed reminder devices) on the reduction of EMFs for people with TBI. A second randomized controlled trial provides evidence that compensatory cognitive rehabilitation reduces anxiety and improves self-concept and interpersonal relationships for people with TBI.

In the absence of strong and sufficient evidence for a direct effect of cognitive interventions on health and employment, we examined a causal pathway linking cognitive rehabilitation to intermediate measures of cognition and subsequent associations between those measures and health or employment. Two small randomized controlled trials (Class I) provide limited evidence that practice and CACR improve performance on laboratory-based measures of immediate recall. However, no studies evaluated the link between cognitive tests and health outcomes, and associations between performance on cognitive tests and posttrauma employment and productivity were inconsistent.

Future Research on Question 3

Identifying and evaluating outcomes that are relevant to people with TBI and their families is the first priority of a research agenda. Among the studies we reviewed, perhaps the most pragmatic outcome measure used was that of everyday memory failures. It is possible that the absence of treatment effect in these studies could be a function of the study's lack of relevance in the lives of the people being evaluated, represented in outcome measures and interventions that have little meaning to those people.

It is also important to identify the laboratory tests that are strongest and most reliable in their ability to measure cognitive function in relevant contexts, and to standardize their use across research projects and hospital and clinical settings.

Two other questions for future research on topics not specifically addressed in this review are: (1) When is the client ready for the intervention? and (2) What are the markers of that readiness? Large, multicenter comparisons may provide initial information for a research design to investigate these questions.

In general, the studies in this review that did not produce a treatment effect compared one form of cognitive rehabilitation with another form, CACR to non-CACR practice, and were specific to unstructured rehabilitation methods. Treatment effects were not observed when one kind of remediation was compared with another when there were equal levels of stimulation for both treatment and comparison groups. What are the differential effects of general stimulation and technology? As TBI rehabilitation technology grows, costs escalate. Consequently, certain subsets of the total population of survivors--those with liberal insurance policies and/or private money--will receive the intervention. It is important for clients as well as payers to know if the new technology leads to improvement or whether the increased level of stimulation used to deliver the technology results in the improvement.

Question 4: Does the application of supported employment enhance outcomes for people with TBI?

The goal of supported employment is to enable people with severe long-term or permanent deficit to resume a productive life through on-site aid and advocacy provided at the place of employment. Programs in supported employment began in the late 1970s as university-based demonstration projects and then became a part of government-sponsored rehabilitation programs. They have been applied to a wide range of populations who were previously considered unemployable, particularly people with mental retardation, but also including people suffering from neural, psychiatric, and physical disabilities (Wehman, Revell, Kregel, et al., 1991). More recently, the techniques have been applied to help survivors of TBI resume a productive life.

Chronic unemployment has both a personal and a social cost. For the person, regular work is an important source of personal satisfaction and social identity (Partridge, 1996). It not only may provide financial resources, but it also forms the basis of self-image and a claim on social recognition and reward (Shepherd, 1981). Work and a sense of vocation can contribute to a personal sense of worth and competence, a sense of belonging and well-being, and to other psychological states essential to mental health (Pettifer, 1993). The fundamental value of work is illustrated by Roe's (1956) suggestion that it is the only social role that can fulfill all the stages of Maslow's (1987) hierarchy of needs, ranging from safety, through esteem, to self-actualization. Chronic unemployment, especially beginning early in life, is an important threat to personal mental health. Survivors of TBI often were injured just as they approached or reached their full potential as workers. The social cost is evident when we consider that more than 60 percent of survivors of TBI are men under 35 years of age (Wehman, West, Fry, et al., 1989). This is precisely the population who tend to be highly skilled workers, at the peak of their powers, with 30 years or more of productive life remaining. That contribution to society is foreclosed by their absence from the work force or by the greatly diminished roles they must play after injury. And it is not only gainful employment that is lost to the person and to society, the loss also includes the whole variety of a person's productive work as a student, homemaker, and other important social contributions which the person might have made (Sander, Kreutzer, Rosenthal, et al., 1996).

Definitions

There are at least five models of supported employment: (1) individual placements, (2) work enclaves, (3) apprenticeships, (4) small businesses, and (5) mobile work crews (Powell, Pancsofar, Steere, et al., 1991). The most common model is individual placement, which provides training and ongoing support individually to each survivor, in settings where fewer than 5 percent of the workers are disabled. The aim is to provide a quality match between worker and job requirements, including high job satisfaction by both worker and employer and decent wages (Ellerd and Moore, 1992). This is the model usually recommended for survivors of TBI (Wehman, Kreutzer, Stonnington, et al., 1988), though a variation of the apprenticeship model has also been tried (Curl, Fraser, Cook, et al., 1996). One of the most detailed definitions of the individual placement model is by Kreutzer, Wehman, Morton, and colleagues (1988). They identify four essential components, all of which must be tuned to the type of deficit of the client (in this case, the client with TBI):
  • Job placement. This includes (a) matching job needs to client abilities and potential, (b) facilitating employer and client communications, (c) facilitating caretaker communications, (d) arranging travel arrangements or training, and (e) analyzing the job environment to detect potential problems.

  • Job site training and advocacy. This emphasizes the active role of the employment specialist, job coordinator, or job coach, who is often cited as the key professional in supported employment programs (Wehman, West, Fry, et al., 1989; Ellerd and Moore, 1992). The job coach serves functions usually left to the employer in conventional vocational rehabilitation (e.g., training). The job coach also is proactive in identifying problems and designing solutions in cooperation with all the parties involved.

  • Ongoing assessment. This involves continuous monitoring of key aspects of the client's work performance. There is an intense intervention by the job coach at the beginning, but this is expected to diminish, or "fade," as the client settles into a successful work adjustment (Ellerd and Moore, 1992; Wehman, Sherron, Kregel, et al., 1993). This process is well illustrated in Figure 1 of the article by Wehman, Kreutzer, West, et al., 1990.

  • Job retention and follow-along. A continuing, proactive process in which the job coach tries to anticipate problems and intervene early to prevent crises from disrupting the client's adapted job placement. This assistance to the client is of indefinite duration, although it is expected to diminish over time (Wehman, Sherron, Kregel, et al., 1993).

The hallmark of supported employment methods is that they are applied on the job, in the actual work environment, to help the client succeed. Off-job training and practice to prepare the client for work may be an important prelude to supported employment in some programs, but the job coach always accompanies the client to the job site to work out on-the-spot solutions to problems as they arise and to mediate between employer and client. This problem-solving-in-situ is a defining principle of the method of supported employment (Kreutzer, Wehman, Morton, et al., 1988). Finally, these programs usually aim at competitive employment, usually defined as employment in a setting about 95 percent occupied by workers without disabilities and paying at least the official minimum wage (Wehman, Kreutzer, West, et al., 1990; Ellerd and Moore, 1992). They do not aim at placement in sheltered workshops or other settings designed primarily to accommodate the needs of disabled workers. There is a strong commitment to placing the client in the highest job position possible and to approach or exceed the preinjury level of work.

Supported employment is necessary only in cases where standard vocational rehabilitation is not sufficient to secure the desired level of employment for a survivor of TBI. In this respect, supported employment could be considered an extension of vocational rehabilitation into the actual job site as the final stage of helping a particular survivor resume a productive life. Studies of postinjury employment in which survivors are sorted by severity of injury show that not all survivors of TBI require this extra step. People suffering mild injury (GCS = 13) are usually reemployed at high rates: from about 60 to 85 percent within 1 year postinjury, and this high rate is maintained up to 15 years later (Dikman, Temkin, Machamer, et al., 1994; Schwab, Grafman, Salazar, et al., 1993; Edna and Cappelen, 1987; Fraser, Dikman, McLean, et al., 1988). In those same studies, people suffering from moderate or severe injury do not fare as well. The reemployment rates for moderate injury (GCS = 9 to 12) for the same periods are 50 to 60 percent, and for severe injury (GCS = 8), reemployment ranges from 20 to 30 percent.

The GCS alone may not always be the best predictor of employment success in multivariate analyses including other severity measures (Abrams and Toms Barker, 1991). It seems evident, however, that supported employment is most necessary for severe injury because regular vocational rehabilitation programs are insufficient. Even a variety of other interventions before job placement--such as cognitive training, with and without occupational trials, and behavior modification--show only limited success (Wehman, Kreutzer, West, et al., 1990). In addition, about one-half of survivors with moderate TBI and at least 15 to 20 percent of survivors with mild cases also might benefit from supported employment programs.

Ideally, as an extension of vocational rehabilitation, supported employment would address the problems that lead to lost jobs. Devany and colleagues at the Medical College of Virginia (Devany, Kreutzer, Halberstadt, et al., 1991) found that survivors of TBI who had trouble with reemployment suffered from four kinds of difficulties:

  • Somatic problems, like debility, loss of balance, and motor deficiencies.

  • Cognitive problems, like loss of memory, inability to focus attention, obsessions, and indecisiveness.

  • Behavioral problems, like inertia, restlessness, depression, and impatience.

  • Communication and social problems, like contentiousness and various disorders of speech and writing.

They also found that the survivors' scores on the Minnesota Multiphasic Personality Inventory (MMPI) showed peaks on scales 8 (schizophrenia), 4 (psychopathic deviate), and 2 (depression), in that order of magnitude. Valid MMPI scores might be problematic with this population, but the pattern found seems to match the common clinical impression. A configuration of 8-4-2 on the MMPI indicates a depressed person with severe interpersonal and social deficits who could easily alarm or offend others. Add this to the various motor and cognitive deficits already noted, and we have a formidable set of obstacles to placing and maintaining a person with a severe TBI in a job setting. The underlying assumption of the supported employment model is that all people referred to the program are employable under suitable conditions (Wehman, Sherron, Kregel, et al., 1993). Successful programs focus on finding or making those conditions in support of client success at work.

Of the 93 articles retrieved for review, 42 were excluded based on initial exclusion criteria, reducing the total number of articles to 51. Two investigators read all articles retrieved through the database search, as well as five additional articles acquired from reference lists and recommendations from peers, for a total of 56 articles.

Direct Evidence

There is no direct evidence from randomized trials about the efficacy of supported employment.

Indirect Evidence

No Class I or IIa studies of supported employment were found in the literature. In one prospective, controlled, observational study, Haffey and Abrams (1991) measured job placement and retention rates of 130 participants in a program of supported employment, the "Work Reentry Program" or WRP. These results were compared with those of 35 clients in a day-treatment program and 76 individuals who had received no postacute rehabilitation (the "comparison group"). Participants in the WRP program were recontacted every 6 months for up to 3 years. Other subjects were followed for varying amounts of time over 3 years, depending on when they entered the study. A total of 87 (67 percent) of the 130 participants entering the program were placed in employment. Followup for the 87 placements was as follows:

  • 1 to 6 months of followup: 18 participants.

  • 7 to 12 months of followup: 23 participants.

  • 13 to 18 months of followup: 17 participants.

  • 19 to 24 months of followup: 15 participants.

  • > 24 months of followup: 14 participants.

The second series has been reported in a number of publications (Wehman, West, Fry, et al., 1989; Wehman, Kreutzer, West, et al., 1989; Wehman, Kreutzer, West, et al., 1990; Wehman, Sherron, Kregel, et al., 1993). These studies evaluated the outcomes of supported employment in a prospective registry study. In the first article cited, the sample included five survivors followed for 75 weeks (1.4 years); by the last article in the series the sample had increased to 115 consecutive referrals followed for up to 60 months (5 years). These individuals passed through two consecutive phases of vocational rehabilitation: first, the standard postrehabilitation services, then a supported employment program.

For convenience in the remainder of this report, we will refer to the first study as Haffey and Abrams and to the second series of studies, taken as a group, as the Virginia series, after the home of the researchers in the Medical College of Virginia.

Posttrauma vocational success in the Virginia series was compared with the rates of preinjury employment success of each client, who served as his or her own control in the study. Preinjury employment is thus taken as a baseline control for results in the two subsequent phases of intervention--the last of which was supported employment--as each client passed through the following history: Preinjury employment (baseline) => posttrauma employment (1st phase intervention) => supported employment (2nd phase intervention).

Measures of employment success in the Virginia series were (1) number of jobs held per client, (2) mean hourly wage, (3) mean monthly wage, (4) mean annual wage, (5) monthly employment ratio (MER). The last is an index of vocational success developed by the Virginia group. It is the ratio (with specific definitions of the two variables): number of months client employed/number of months client could have been employed (Wehman, Sherron, Kregel, et al., 1993).

Results were measured over 5 years of operation with measures of outcome taken weekly (Wehman, Kreutzer, West, et al., 1989). During that time, 80 of the 115 entering clients were placed in jobs, but it is not clear how many of the 115 were followed for all 5 years. In the whole series of studies, we have reports on 5 clients in 1989 (Wehman, West, Fry, et al., 1989) and 20 clients later in the same year (Wehman, Kreutzer, West, et al., 1989). In 1990, there is a report of 53 clients (Wehman, Kreutzer, West, et al., 1990) and in 1993 the total is 115 (Wehman, Sherron, Kregel, et al., 1993). From this pattern in the reports, we may infer that about five clients were followed for a full 5 years, 15 clients for between 4 and 5 years, 33 clients for at least 3 years, and 62 for less than 3 years.

Selection and allocation of clients

There was no random selection or allocation to groups in either of the studies reviewed. In the Haffey and Abrams study, assignment to the two treatments and the on "comparison group" was "determined by factors that ordinarily lead to referral to rehabilitation services," according to the authors. (1) Clients in the WRP (supported employment program) were referred by the State rehabilitation department if they had employment potential "under the right circumstances" (which perhaps meant a program like the WRP). Clients believed to have "absolutely no employment potential" by rehabilitation counselors, the clients themselves, or family members were not admitted to the WRP. (2) The second treatment group (the day-treatment program) contained survivors for whom "competitive employment was not a current goal" because of medical problems, personal and family preference, economic disincentives (pension, social security), and other engagements (homemaker, student). (3) The comparison group was made up of consecutive discharges from inpatient TBI rehabilitation who did not elect to attend the WRP because they (a) thought the services unnecessary, (b) believed they were too disabled to work, (c) played a dependent role with caregivers, (d) feared jeopardizing benefits, or (e) were active substance abusers.

In the Virginia series, the sample was 115 consecutive referrals by clients' supervising physiatrists to the supported employment program. All met the following criteria: (1) age between 18 and 64 years, (2) severe TBI: GCS 8 for 6 hours, (3) strong evidence that the person could not work successfully without ongoing job support, like previous postinjury failure, client doubts, or doubts by physician, family, or counselors. No client was excluded simply for having cognitive, physical, or psychosocial deficits. Some of the studies in the series (1990) indicate that clients were also excluded on evidence of active substance abuse.

Models of supported employment tested

Both studies used some variant of the individual placement model of supported employment, but the two versions differed significantly. Both programs had extensive analysis of client characteristics, preferences, abilities, and deficits to guide optimum placement of the clients, the active participation of the job coach at the work site, and continuing but "fading" support for the client on the job. The analyses of client need and capacities and job requirements are extremely detailed in both programs, but Haffey and Abrams appear to use more behavioral criteria (like simulated work samples), and the Virginia group seems to rely more on screening and respondent information (see Wehman, Kreutzer, West, et al., 1989 for the screening form used). However, the program used in Haffey and Abrams had a component of preemployment training available to the clients which was not a feature of the Virginia program. Haffey and Abrams included two preemployment training sessions for the clients: (1) work hardening, using real and simulated work activity to develop "stamina, work competencies, work behaviors, and productivity levels"; and (2) the Transitional Employment Program (TEP), placing the client in a salaried capacity in the hospital dietary or environmental services department with a job coach for 3 to 4 months. These features are in contrast to the Virginia model, which is predicated on the "assumption ... that ... cognitive retraining, work adjustment, work hardening and social skills training, may be best provided at the job site while the person is already employed." This is a fundamental difference in approach which is made explicit by a later statement in the same place: "Supported employment does not promote job readiness training, but instead emphasizes using a person's current abilities and strengths" (Wehman, Sherron, Kregel, et al., 1993).

Outcomes

Table 7. Postinjury employment outcomes of TBI clients in a supported employment program
PreinjuryNo SE1SE
Employment outcome(n = 62)(n = 37)(n = 80)
Mean number of jobs/client2.041.241.49
Mean hourly wage earned$4.19$1.55$4.90
Mean monthly wage earned$508$107$658
Mean annual wage earned$6,101$1,290$7,899
Monthly employment ratio0.40 0.130.67
1

SE = supported employment.

Source: Adapted from table 3 , Wehman, Sherron, Kregel, et al., 1993.

Outcomes are summarized in the evidence tables. In the Haffey and Abrams study, 68 percent of the WRP clients secured competitive employment, and only 18 percent were considered chronically unemployed. Only 39 percent of the day-treatment group and 34 percent of the comparison group reported any employment after discharge. At the last followup period reported, 71 percent of the WRP clients placed were still working, but no retention rates for the day-treatment and comparison groups were reported. See Table 7 for a summary of the results from the Virginia studies (Wehman, Sherron, Kregel, et al., 1993).

Conclusions for Question 4

There is Class IIb evidence that supported employment can improve the vocational outcomes of TBI survivors. Almost all information about supported employment comes from two bodies of work, each of which use different experimental designs and different models of supported employment. The findings have not been replicated in other settings or by other centers, so the generalizability of these programs remains untested.

In the Virginia studies, the clients all had severe cases of TBI as rated by the GCS. In the Haffey and Abrams experiment, no GCS scores are given, but the data provided on severity of injury show median length of coma in the three groups ranging from 6 to 7 days, with the median value for the entire sample of 199 cases at 7 days and the overall range from 0 to > 30 days. In the 80 job-placed survivors of the Virginia series (Wehman, Sherron, Kregel, et al., 1993), the average length of coma was 48 days, and the range was from 0 to 182 days. Clearly, the Haffey and Abrams sample contained many people with moderate or even mild injuries, while the Virginia sample consisted entirely of people with severe injuries. We have already noted, in the Introduction to this report, that severity of injury has an important effect on vocational success.

There also are difficulties in interpretation that are derived from problems with the individual study designs and with confounded variables and biases in the groups being compared. In both studies, the prospective data collection avoids the hazards of retrospective inference, but the lack of a control condition in the Virginia studies and the highly biased allocation of clients to the groups being compared in the Haffey and Abrams research make it impossible to clearly interpret results. In the Haffey and Abrams study, there are so many differences among the groups being compared that comparisons are almost meaningless. The supported employment group is heavily biased toward better vocational outcomes, containing only clients specially selected by vocational counselors as likely prospects for work. The day-treatment group, however, was filled with clients for whom "competitive employment was not a current goal," and the comparison group was made up of clients who had rejected a chance at supported employment and had multiple motives to avoid work altogether. Then, when the three groups were tested for differences in client characteristics (see Table 1, Haffey and Abrams, 1991), the only difference found was that the comparison group was significantly less likely to have been employed at the time of injury. With a stacked deck, no one is surprised when the dealer wins the hand, and the superior vocational performance of the supported employment group in this experiment is likewise an anticlimax.

The problems with the Virginia series are of another sort. They arise from the inherent limitations of the design itself, since case-control studies without separate control groups and unbiased allocation of participants are unable to untangle confounded variables. Repeated measures on a single group are bound to be confounded with variables for which there are no controls. An observation made by Wehman, Sherron, Kregel, et al. (1993) will illustrate the problem. They note that during the economic recession of 1990 to 1992--the worst in the United States since the 1970s--nearly 20 percent of their program participants lost their jobs due to layoffs. The design of the Virginia studies compares baseline levels of employment preinjury with subsequent performance under two levels of vocational rehabilitation, including supported employment as the final stage.

In the Virginia sample, the average age at injury was 24.8 years, and the average age at referral to the program was 30.9 years, making the average interval from injury to entry in the program 6.1 years. The average time to job placement after program entry is about 1 year more, and the subsequent followup in the series of studies under review ranges up to 5 years, with a substantial proportion of the clients at least 3 years into followup. Simple arithmetic discloses that the average time from preinjury employment to postinjury followup is on the order of 10 to 12 years, and for about half the clients the interval will be even longer. This is the time elapsed between baseline measures of preinjury vocational success and postinjury outcome measures under supported employment. It is a significant possibility that economic changes over a 10- to 12-year period (or more, for half of the sample) would have significant effects on employment. Those economic effects will be confounded with the effects of supported employment programs running at the same time, and there is no way to separate the two kinds of effects unless a control group of clients, without supported employment, is measured over the same interval. Likely, there are many other confounded variables at play in the same way, including unknown ones.

In spite of the problems mentioned, it remains true that all the programs of supported employment reviewed showed better rates of vocational success than the baseline expectations of survivors of TBI who received only standard postacute rehabilitation or even with special kinds of preemployment vocational counseling and training (see "Problems Addressed" section in the Introduction to this report). The success documented by the Virginia series with survivors with severe injuries is especially convincing in this respect. Supported employment appears to be a promising way to increase the vocational success of survivors of TBI, but the present literature does not give definitive proof of its effectiveness and does not provide enough clarity on why it works or guidance to the best applications of the method.

Future Research on Question 4

Experimental designs

The greatest overall need for the evaluation of supported employment programs is a series of trials with adequate controls and unbiased allocation of clients to the conditions compared. The prototype of this kind of evaluation is the randomized, controlled trial (RCT), in which a representative sample from a population of survivors of TBI is randomly assigned to programs in supported employment and to various control conditions, which may include alternate interventions, no interventions, or both. These experiments may be very difficult or impossible to do because of the conditions under which rehabilitation programs operate. There may not be access to representative samples of survivors of TBI, for example, or it may be difficult or impossible to insulate the different experimental conditions from each other when the clients and caregivers from the different groups live in the same community and have informal social exchanges with each other. The same may be true for professional staff. Sometimes ideal experimental conditions must be approximated and sufficient measures taken to allow supplementary regression analyses to clarify confounded variables or covariance analyses to control for unavoidable allocation biases. These are the realities of field research. However, we need better studies than we now have to clarify the effects of supported employment.

Independent variables

In addition to the main independent variables of intervention and control groups, a number of measures of client characteristics may be reconsidered in light of past research. On the matter of injury severity, for example, the general rule holds that clients with moderate to severe TBI injuries (GCS < 10) are most at risk for poor vocational outcomes in unsupported work settings (see Introduction to this review). Stambrook, Peters, Deviaene, et al. (1990) found that admission GCS scores, low preinjury vocational status, older age, and physical and psychological problems were the best discriminators of postinjury success.

The Virginia studies focus entirely on clients with severe injuries (GCS < 8) because that is where most of the problem lies. However, the link between severity of injury and unemployment is not perfect, and a substantial group of survivors with even mild injuries (15 to 40 percent) fail at work. In a study of predictors of vocational success 1 year after injury (Cifu, Keyser-Marcus, Lopez, et al., 1997), the Virginia group found several effective measures, including injury severity (admission GCS, highest GCS, length of coma, and length of PTA); acute measures of physical functioning (admission FIM, admission DRS, discharge DRS); cognitive functioning (logical memory delay); and behavioral functioning (admission RLAS, discharge RLAS, NRS excitement factor). But very long intervals can elapse between injury and reemployment: an average of 5 to 7 years or more is common, with half of clients waiting longer times (Wehman, Sherron, Kregel, et al., 1993; Courtney, 1992; Roessler, Schriner, and Price, 1992). There is a need for finer discrimination among the states of deficit at the time of entry into employment programs than is afforded by GCS scores in the acute phase.

One possibility is to use more proximate assessments of deficit which assess abilities needed in the workplace. If supported employment programs are aimed at clients with greatest risk of vocational failure--as in the Virginia series--postacute measures may be better predictors of postinjury work success. For example, some cognitive deficits (executive function/flexibility), emotional disturbances (aggressiveness, depression), and low ADL ratings appear to be better predictors of employment after TBI than severity of injury (Crepeau and Scherzer, 1993). The research done by the Virginia group on "easy" and "difficult" groups of clients to place and train in employment settings (Wehman, Kregel, Sherron, et al., 1993) may be another basis for better discrimination of client characteristics and better matches between clients and work settings, as is the work done on the kinds of problems leading to job loss in supported employment programs for clients with TBI (Sale, West, Sherron, et al., 1991).

Another class of independent variables might be called cointerventions and concurrent variables. Cointerventions are the unprogrammed interventions made by family, coworkers, employers, and so on that may affect success or failure on the job. These are difficult to identify and measure, but it is unrealistic to assume that the job coach is the only helper or advocate of the client, and these other interventions may have powerful effects on outcome. An example of concurrent variables is the observation (Wehman, Sherron, Kregel, et al., 1993) that, in one instance, 20 percent of clients in a supported employment program lost their jobs to layoffs during an economic recession.

Dependent variables

Also important with regard to outcome variables are length of followup and frequency of measurement of outcomes. Some studies take weekly measures (the Virginia series) and others longer periods, such as every 6 months (Haffey and Abrams, 1991). Generally, frequency of measurement depends on how detailed the knowledge of job adjustment needs to be for effective job coaching. In the early stages, close monitoring is necessary; as the job coach "fades," the measures may be more spaced. More important for assessing the efficacy of supported employment is the length of followup. We recommend that followup be an integrated part of all supported employment programs, as a built-in component, and that it go on indefinitely. The play of variables that determine vocational success may act over long periods of time, and adequate length of followup approximates the entire work career of the client. The example of the Virginia series, which made periodic updates on a cumulating sample, shows the value of this strategy.

Another issue related to outcome is the criterion of vocational success. If a broader criterion is adopted, it would extend the range of the methods of supported employment into those of supported activity. The list of primary areas of activity (Sander, Kreutzer, Rosenthal, et al., 1996), which includes homemaker, student, volunteer, and retired, as well as competitively employed, and specially employed (including supported employment), is one approach to a set of criteria for vocational success which is broader than simply work-for-wages. Another approach is age-appropriate activity, as proposed by Prigatano, Fordyce, Zeiner, et al. (1984), which gives due weight to homemaking and schooling as successful vocations.

Some of the methods designed for supported employment (onsite aid and advocacy, the activity coach) might be extended experimentally to settings in the home and school. The Monthly Employment Ratio (MER), a measure of vocational success developed by the Virginia group (Wehman, Kreutzer, West, et al., 1989), has gained some currency in the field and is worth adopting as a standard outcome measure for supported employment. It could easily be extended into a more general measure, a Monthly Activity Ratio (MAR), based on similar principles of definition, for studies adopting a wider set of criteria of vocational success.

Strategies of evaluation

The main focus of the work reviewed here is what may be called outcome evaluation. This strategy is entirely appropriate in medicine when seeking a basis for treatment in evidence, but there might be some utility to other modes of evaluation as well. Observations of process, participant perspectives on the programs (by clients, staff, employers, family, etc.), and assessment of client empowerment could add entirely new dimensions to our knowledge of how programs work. These approaches to "unpacking the black box" of a supported employment program would aim to show how successful programs produce their effects and why unsuccessful programs fail. This is the kind of detailed information we need to improve the design of interventions. It is likely that much remains to be discovered about how individual differences among clients interact with aspects of the programs serving them. Johnson (1987) found that factors like ability to return to one's previous job, being provided a work trial or easier work, and long periods of support were more important in determining successful reemployment than the client's state of deficit. These are typical benefits provided by supported employment. But what makes for easier work, what is support, and what variations in both answer the needs of particular survivors? Many details remain obscure. In many instances, alternate approaches to evaluation will require qualitative methods in combination with the quantitative measures of job retention and success. Models of these other types of evaluation are available from a wide variety of applications, and there is a developing set of methods for applying them (Chelimski and Shadish, 1997). Some work along the suggested lines is already being done--the studies of client characteristics cited in the discussion of independent variables are examples--but an expanded effort to measure the operating details of the programs might be useful in the design and implementation of new or improved programs.

Models of supported employment

Most of the work found in our search was done on one model of supported employment. The individual placement model is most favored because it is the most flexible and appropriate one for returning individual survivors to their preinjury workplace or to new settings where their particular abilities and deficits allow a successful adjustment. The practical nature of this model of supported employment is its own justification. However, its success has perhaps obscured some good reasons for more work on other models.

Recently, a variant of the apprentice model has trained supervisors and coworkers to act as on-site "job coaches" for workers with TBI (Curl and Chisholm, 1993; Curl, Fraser, Cook, et al., 1996). Even with provision of salary subsidies to the "job coaches," this model offers a potentially effective and relatively low cost method of providing supported employment. Some coworkers refused payment for their services, and the ones paid cost only about 10 percent of the salary of a professional job coach (see Table 2, Curl, Fraser, Cook, et al., 1996). Even if coworkers were paid for as long as the average professional job coach, it would still be much less costly to provide this service. This may be an especially effective model in settings of professional and highly skilled work forces, where the coworker has the knowledge and skill to be the most effective helper.

Another model which may be worth considering is a revised concept of the work enclave as a work setting designed to fit the abilities and deficits of survivors of TBI, perhaps in company of people with complementary deficits, like other physical disabilities, or with family caregivers. Although a departure from the trend toward integration and normalization of TBI survivors at work, this approach may have certain benefits, especially for the most severely disabled. All models of supported employment were first applied to non-TBI populations, and this modified version of a work enclave is proven effective with some of the same populations served by early programs of individual placement, such as people with chronic mental illness (Fairweather, Sanders, Maynard, et al., 1969).

This different version of the work enclave might offer some of the same resources of natural support as other social settings--like community support groups--which enhance and enable the survivor's life: the camaraderie of fellow survivors and the intrinsic interest and help of family and friends. The combination of work and social relations available in this kind of milieu may have some potential to increase both vocational success and quality of life for survivors of TBI in the same setting and the same program. If effective, it could provide a powerful combination of benefits to relieve that part of the burden of illness in TBI which is linked to vocation and work, providing a personal sense of worth and competence, a sense of belonging and well being, and other psychological states essential to mental health (Pettifer, 1993).

Question 5: Does the provision of long-term care coordination enhance the general functional status of people with TBI?

Some long-term functional setbacks and disturbing psychosocial sequelae may not become apparent in survivors of TBI for several years. Some consequences are even preventable, but time is often critical to maximize treatment and forestall secondary effects. One response to issues of how and when to access TBI rehabilitation has been case-management programs designed to monitor survivors and match them with appropriate services. The various impairments that survivors experience often give rise to secondary problems of vocational failure, social isolation, and extended functional dependency that can increase over time at various rates (Brooks, Campsie, Symington, et al., 1986; Goering, Farkas, Lancee, et al., 1988; Kaitaro, Koskinen, and Kaipio, 1995; Olver, Ponsford, and Curran, 1996; Schalen and Nordstrom, 1994; Spatt, Zebenholzer, and Oder, 1997; Van Balen, Mulder, and Keyser, 1996).

TBI impairments present three major survivor- and family-adjustment issues for which case management is a recommended solution. One problem is that survivors may not receive appropriate postacute clinical rehabilitation services, or they may enter programs too early or too late to benefit. There is growing evidence that some effects of TBI can be ameliorated by postacute rehabilitation as late as 10 years postinjury (Hall and Cope, 1995; Johnston and Lewis, 1991; Spatt, Zebenholzer, and Oder, 1997). In spite of this knowledge, survivors and their families may not be entering functional improvement and/or psychosocial support programs at strategic postinjury points. This has been attributed to fragmented responsibility for screening, lack of clarity about how to identify rehabilitation readiness, and lack of accountability among program providers (Greenwood and Brooks, 1994). One reason for the lack of extended rehabilitation could be that programs are either not locally available or are not supported with incoming clients as reported in Europe (McMillan, Morris, Brooks, et al., 1988; Van Balen, Mulder, and Keyser, 1996).

However, other explanations pertain to the nature of the population needs. As the postinjury time increases, the difficulties experienced by survivors of TBI tend to be increasingly subtle and diverse, and informal caregivers fail to recognize and determine their needs. Professionals in primary and specialty care services also can experience confusion about what should be done at which points in the postinjury continuum by which disciplines in which types of service agencies. Unless an advocate is available to maintain interagency relationships and awareness of program improvements and opportunities, it is difficult for survivors of TBI, their families, and their professional caregivers to create a timely recovery agenda and facilitate access.

A second problem for which case management is a projected solution is the relatively low reemployment rate among survivors of TBI. According to Malec, Buffington, Moessner, et al. (1995), the long-term unemployment rate among patients with moderate to severe injuries without vocational intervention is low--about 50 percent--and only one-third resume independent competitive employment. Studies also have shown that the period between brain injury and return to work or initiation of vocational services is long--about 5 to 7 years (Wehman, Sherron, Kregel, et al., 1993; Courtney, 1992; Roessler, Schriner, and Price, 1992).

Without appropriate employment support, survivors may experience additional psychosocial problems because of misinterpretation or lack of understanding about the symptoms. For instance, concentration and memory problems may be perceived as lack of motivation, insensitivity, or mental illness. Most survivors need assistance developing career goals, learning work skills, and seeking and maintaining employment. This is based on evidence of improvement with declining long-term unemployment and underemployment rates being attributed to employment support and work reentry programs for greater numbers of survivors of TBI (Sample and Rowntree, 1995). Because vocational rehabilitation programs that support employment entry or reentry are not a standard feature of TBI clinical rehabilitation programs, case managers or vocational coordinators are considered one means of bridging the agency gap between rehabilitation and reemployment.

A third TBI-related problem for which case management is recommended is the issue of family burden. Studies of head injury effects on family life have shown that cognitive impairments and personality changes are more disruptive than physical disabilities (Cavallo, Kay, and Ezrachi, 1992; Gleckman and Brill, 1995; Godfrey, Knight, and Bishara, 1991; Hendryx, 1989; Kreutzer, Marwitz, and Kepler, 1992; Kwasnica and Heinemann, 1994; Leathem, Heath, and Woolley, 1996; Livingston, 1987), and that parents are better able to withstand such stresses than spouses (Panting and Merry, 1972; Thomsen, 1974). Rosenbaum and Najenson (1976) found that wives of survivors of brain injury experienced more strain and a greater sense of isolation and loneliness than did wives of paraplegics. Others also report evidence of subjective family strain and friction (Brooks, Campsie, Symington, et al, 1986; Weddell, Oddy, and Jenkins, 1980). The burden on families is so widely recognized that programs aimed specifically at support or assistance for the relatives of survivors of TBI are being developed (Carnevale, 1996; Peters, Gluck, and McCormick, 1992; Ragnarsson, Thomas, and Zasler, 1993; Sanguinetti and Catanzaro, 1987). This problem of family difficulty in coping with the effects of TBI merits a broad effort to identify antecedents and effective approaches, including case management.

Definitions

Case management has emerged as a possible solution because it systematically monitors client needs over time and facilitates access to services in various institutions and programs across communities. Case managers usually serve people with long-term or chronic conditions because they have complex needs and find it difficult to navigate the health and/or social care systems.

According to the Commission for Case Manager Certification (1996), case management is: A means for achieving client wellness and autonomy through advocacy, communication, education, identification of service resources and service facilitation while ensuring that available resources are being used in a timely and cost-effective manner in order to obtain optimum value for both the client and the reimbursement source (p. 2).

The role typically includes admission or intake assessment, care-plan development, service referral, coordination of service details, and collaboration with care providers, informal caregivers, and the client (Goering, Farkas, Lancee, et al., 1988; Goodwin, 1994) and may also include authorization of service payments (Ashley, Krych, Persel, et al., 1994; Evans and Watke, 1995). The domain is to determine service needs and to access service elements with a sequence and timing that will result in desired outcomes for the client and family as well as desired outcomes such as cost control for the service organization.

Case Management Characteristics and Desired Outcomes

One characteristic of case management is the adopted mission of the employing organization. Since case managers are found in hospitals, rehabilitation programs, health departments, aging services departments, mental health services, insurance companies, and managed care organizations (Gerber, 1994), the focus can vary from acute-care disposition planning to long-term patient advocacy to service cost control. As the orientation and purpose of case management programs vary, outcomes may reflect the differences. In order for case management interventions to be compared and tested for effectiveness, it is important to define the specific purposes and aspects of case management that are provided.

Case managers also focus on helping clients move across institutional or organizational systems and across provider disciplines. Managing these boundary issues calls for a collaborative approach around a common focus--the client and family. Understanding case management role specifications and the extent of boundary work is also critical for comparing programs and interpreting research that tests case management effects.

Within this context of TBI incidence and long-term effects, problems experienced by clients and their families, and the definition and role of case management, our study was conducted to identify evidence of case management effectiveness. The purpose was to review the literature for controlled clinical studies of the influence of care coordination on targeted outcomes among TBI rehabilitation populations of clients and their families.

Of the 69 articles retrieved for review, 27 were excluded based on the initial exclusion criteria, reducing the total number of articles reviewed to 42. Two investigators read all retrieved articles from the database search, as well as relevant articles found on reference lists of the retrieved articles and those obtained from colleagues, for a total of 73 articles. The only criterion for study selection in this phase was that case management was an independent variable. By mutual agreement three studies were critically analyzed and entered into Tables 1 and 2 to report evidence of case management effectiveness in TBI rehabilitation.

Results

Does the provision of long-term care coordination enhance the general functional status of people with TBI? The search strategies yielded three controlled studies of case management effectiveness in TBI rehabilitation. Two studies compared case management with non-case management, and one study compared two types of case management. Two studies were completed trials (Ashley, Krych, Persel, et al., 1994; Greenwood and Brooks, 1994), and one article (Malec, Buffington, Moessner, et al., 1995) presented preliminary results after 1 year of data collection.

Although all the studies addressed case management effectiveness, they differed in most of the design characteristics, as reported in Table 1. Regarding study purpose, Ashley, Krych, Persel, et al. (1994) focused on the level of independence following rehabilitation, while Greenwood and Brooks (1994) addressed the rehabilitation process, client employment and quality of life, and family burden; and Malec and colleagues (Malec, Buffington, Moessner, et al., 1995) measured employment outcomes. Two designs were group comparisons, and one design compared outcome rates with previously established baseline rates (Malec, Buffington, Moessner, et al., 1995). In the only clinical trial that tested the effects of case management on client outcomes (Greenwood and Brooks, 1994), the intervention was allocated to sequentially admitted clients in randomized sites. In the other two studies, sequential admission for eligible subjects was also the intervention allocation method, but the subjects were at different stages of recovery. The number of subject withdrawals and the number of exclusions were reported in two papers; in the third, the subjects were all clients who met the inclusion criteria and could be matched to the control group. The sample sizes were moderately high (> 100) in two studies (Greenwood and Brooks, 1994; Malec, Buffington, Moessner, et al., 1995), and small (n = 39) in one (Ashley, Krych, Persel, et al., 1994).

Each selected study focused on a different subpopulation. In two studies, the subjects were homogeneous for level of disability: either moderate disability (mean Disability Rating Scale [DRS] scores of 4.95 and 5.17) (Ashley, Krych, Persel, et al., 1994); or severe disability (mean DRS scores of 16.2 and 18.3, and mean Glasgow Coma Scale [GCS] scores of 6.6 and 5.5) (Greenwood and Brooks, 1994). In the third study, the sample at 1 year consisted of clients with mild injuries (79 percent), as rated with the GCS and moderate or severe injuries (21 percent) Malec, Buffington, Moessner, et al., 1995). Comparison group differences made it necessary to control for aspects that may have affected the outcomes, but no controls were mentioned in the preliminary report by Malec, Buffington, Moessner, et al., 1995.

The studies also tested different models of case management intervention. Ashley, Krych, Persel, et al. (1994) evaluated two insurance-coverage models in which the key aspects were the authority to approve disability payment and rehabilitation service claims, although this was not defined, and differences between the two groups for this characteristic were not reported. Also, the report did not include any other behavioral or role descriptors to compare and contrast the two intervention models. In fact, although a key independent variable was same versus different case managers, it is not clear from the description whether all subjects in one group had the same case manager or whether each subject in the group had one case manager for the entire post-TBI period. Greenwood and Brooks (1994) tested a medical model of case management, defined as clinical needs assessment during acute hospital care, formulation of a proactive rehabilitation plan, and facilitation of rehabilitation cooperation and involvement among patients, family, and professionals.

Malec, Buffington, Moessner, et al. (1995) evaluated a medical-plus-vocational model of case management. They defined it as assessment and rehabilitation planning during acute hospital care for the provision of medical outpatient rehabilitation services and for vocational counseling and planning related to employment services available in the community. Although there were presumably common role behaviors in these two models, there were not enough details offered in the Greenwood and Brooks (1994) report to determine whether the case manager referrals had led to subsequent care coordination by vocational counselors and others. If so, the Greenwood model would have been similar to the Malec model. Only one study identified the discipline or training that the case managers had received (Malec, Buffington, Moessner, et al., 1995). Also, the intervention periods varied by study and by client need, which no doubt influenced the results.

In addition, other design aspects differed among the studies. The data collection points ranged from 1 month to 24 months, with only two studies measuring outcomes at 12 months. In two projects, the research spanned 2 years, but subjects were followed for less than 2 years if they had not entered the study at the beginning. Also, due to the team-oriented nature of case management and the close institutional quarters of the subjects, blind assessments of the subjects were not possible. Therefore, care delivered by the case managers and other team members could have differed among groups and influenced the outcomes. Additionally, there was almost no information about possible cointerventions--such as other service providers--who may have offered care coordination and continuity, and there was very limited information about the other types of rehabilitation services that may have influenced client outcomes.

There are very few studies of the effectiveness of case management. The results of these studies are mixed (Evidence Table for case management, 2). There is evidence from Class III studies that case management improved vocational status. This was associated with the single case manager and insurance approach (Ashley, Krych, Persel, et al., 1994), as well as with the combined nurse and vocational case manager model (Malec, Buffington, Moessner, et al., 1995).

There were conflicting results about the effects of case management on disability or functional status, living status, family impact, and other aspects, and some findings were mentioned in only one study. The clinical trial resulted in no functional status changes among case managed subjects, despite an extended period of rehabilitation (Greenwood and Brooks, 1994). However, when two forms of case management were compared, both the single and multiple case manager/insurance approaches showed significant functional improvements (Ashley, Krych, Persel, et al., 1994).

Findings also conflicted on the effect of case management on subjects' living arrangements. Greater independence was demonstrated with the single case manager and insurance approach (Ashley, Krych, Persel, et al., 1993), while greater dependence was found with the general case manager model (Greenwood and Brooks, 1994). In the only study that measured the effect of case management on families, the result was that families sought more medical care, and they changed their amount of leisure time (although the direction was not identified) (Greenwood and Brooks, 1994). A modest majority of respondents in the Malec, Buffington, Moessner, et al. (1995) study found the case manager helpful, but the report did not mention whether this rating referred to the nurse case manager and/or the vocational case manager. Single-study findings included lower rehabilitation costs and higher disability payments for the single case manager model (Ashley, Krych, Persel, et al., 1993) and identification of unmet case management needs among adolescents, seniors, and alcoholic clients (Malec, Buffington, Moessner, et al., 1995).

Conclusions for Question 5

From our review we conclude that there is no clear evidence that case management is effective with survivors of TBI and their families, but neither is there clear evidence that it is ineffective. Further research is warranted to resolve this question. It is not possible to directly compare the three studies reviewed because there were almost no similarities in design, sampling, or outcome measures that would provide a basis for comparison. Although all 312 subjects had been diagnosed with brain injury and had evidence of impairment, the samples represent different subpopulations based on injury severity level: moderate, severe, and mixed. For the latter sample, results were not reported by level of injury. Similarly, although there was a controlled intervention of case management provided in each study, there were key differences in the definitions and case management model characteristics. In addition, there were few, if any, specifications about the case managers' training, discipline, experience, and roles. Only one report (Greenwood and Brooks, 1994) mentioned the number of case managers who had provided the intervention (three), and it also was the only report that mentioned the number of clients that were managed by each case manager at one time (20). In no case was there any evidence of reliability or validity testing of the case management approach.

In addition, there are other weaknesses that contribute to the inability to draw conclusions from this small group of studies. One potential source of bias is the lack of control for cointerventions that may have provided service referrals, care continuity, and client and/or family support that simulated case management. This might have occurred, for example, when a study case manager referred the client to another program or service, and it also may have occurred within the family support system. Without controlling for such an effect, it is not possible to attribute any results to formal case management. Another problem is that the studies each provided case management for different amounts of time and at different stages of recovery. Moreover, they utilized different periods of time to measure the outcomes, and the measures did not continue longitudinally for all subjects. This had the statistical effect of reducing the number of subjects who were likely to benefit from the intervention. That is, even if the intervention did have a positive effect, the difference may not have been apparent. Also, because of the team-oriented nature of case management coordination, none of the researchers were able to arrange blind assessments of the subjects. For this reason, it is not possible to know whether there are provider biases associated with care provided for particular subjects or subject groups.

Finally, nothing is known about the quality of the rehabilitation programs associated with the case management models demonstrated in the reviewed studies. Greenwood and Brooks (1994) point out that since the experimental subjects did not progress despite greater rehabilitation service contact time, the cause may have been that the case manager did not have the authority to improve the quality of rehabilitation. Since client and family outcomes may be related only to rehabilitation program benefit, it would be useful to know how to control for rehabilitation program quality to identify confounding factors. Another consideration for possible effect on the targeted outcomes is the ability to access the rehabilitation programs. Since rehabilitation access depends on program availability in the community, economic feasibility for the patient, and the knowledge of others--such as family physicians and emergency care teams--it would be useful to have measures of those environmental conditions as additional outcome analysis controls.

Despite these methodological weaknesses and the incompatible findings, however, there are some observations that can be made from the collective findings of these three studies. First, two of the three studies found significant improvements associated with case management in at least one type of functional outcome (Ashley, Krych, Persel, et al., 1994; Malec, Buffington, Moessner, et al., 1995). This suggests that perhaps the model of case management that was employed in the Greenwood and Brooks (1995) study was simply the wrong model. Second, in the Greenwood and Brooks (1995) study, the dropout rate among subjects without a case manager was higher, which suggests that subjects may have found the service useful in a subjective way. These glimmers of evidence from three controlled studies provide substantive implications for continued research that can improve upon the methods described above.

Future Research on Question 5

Research studies in the future need to test for possible effects of case management that have not yet been identified. We believe it is important to conduct clinical trials that specify and test the extent of contact with the client and family, role training and competence, service-approval authority, screening/rescreening frequency, and influence within the rehabilitation community network. Reliability and validity testing also are recommended for measuring case management. In addition, controls should be in place for isolating possible cointerventions that simulate care coordination. The control variables should include postinjury rehabilitation elements such as settings, types of therapies, amount of contact times, goal achievement records, and other aspects that may directly affect client outcomes.

We suggest that there be improved outcome measures used in case management clinical trial studies for TBI subjects. In addition to outcomes of changed client functionality, there should be outcomes of changed family functionality. Since much of case management communication is directed toward helping family members learn what to expect and where to obtain services, relevant outcomes would include family use of community and rehabilitation services and indicators of family assertiveness regarding care expectations. While case management may only indirectly affect a client's functional outcomes such as level of disability, vocational status, and living status, it is possible that case management can directly affect family knowledge of TBI rehabilitation needs and services, level of psychosocial anxiety, and family competency in coping with TBI.

We also recommend separate measures and analyses for subjects with mild, moderate, and severe disability. Greenwood and Brooks (1994) interpreted their findings that more case-managed-group relatives reported a major TBI effect on the family and had more use of prescribed drugs and medical services by attributing the differences to a more severely ill sample in the case-managed group. However, this could not be verified because they had not controlled for severity of illness. Third, if family members were measured at pre- and postintervention points, the case management intervention effects should become more apparent. Finally, for purposes of study comparability, outcomes could be measured at 12-month postinjury intervals.

Chapter 4. Conclusions and Summary of Findings

General Conclusions

The purpose of this document is to provide an exhaustive, evidence-based approach to rehabilitation for traumatic brain injury. In order to make this a feasible undertaking, five specific topics were selected from among the many aspects of TBI rehabilitation. These aspects were closely defined and then subjected to rigorous and explicit evidence-based literature review and analysis.

In producing a "conclusions" section to this work, two issues need to be addressed. First, the results of the literature investigations into the five topics should be summarized. Second, their implications should be discussed. Because of the nature of the evidence-based medicine process and the overall weakness of the literature, however, these processes must be undertaken with care.

Although formulated around specific questions, evidence-based medicine is driven by the literature. For instance, the questions that are developed at the outset are almost never directly reflected in any one individual study much less in a body of literature. Therefore, the results of evidence-based medicine efforts will be strongly influenced by the approaches to individual topics taken in the body of relevant literature and by the strength of those studies. Because of these constraints, it is hazardous to separate a synopsis of the conclusions of an evidence-based medicine analysis from the studies that specifically drive those conclusions. Unless there is a large body of Class I literature, separating summary statements from the strength of their supporting evidence vastly increases the risk of their misinterpretation. For that reason, the summary statements contained in this section with respect to the five questions are strictly limited to reflections of the statements made in their individual sections. Readers are strongly encouraged to study those sections prior to interpreting these summary statements.

In addition, because of the overall weakness of the literature as reflected in this work, clinical interpretation is hazardous. It must be remembered that the absence of evidence is not evidence of absence. Although none of the issues involved in TBI rehabilitation that are addressed in this work are supported by Class I evidence, it must be recognized that there also is not a similarly strong body of evidence standing in disproof. Therefore, because something has not been definitively proven as effective must not be interpreted to mean that it does not have clinical utility, should not be continued, or should not be funded. The proper interpretation would be that, in the presence of a need for treatment and the absence of clearly superior alternatives, choices must be made between therapies without proven superiority over others based on clinical pragmatism.

From a funding viewpoint, it must also be recognized that there is a vast difference between making a choice between alternate therapies based on less than optimal evidence and denying an entire category of therapeutic management based on the absence of strong scientific proof of efficacy. The application of evidence-based medicine techniques to the current body of clinical literature over the past several years has effectively raised the scientific bar much higher than ever before. Although it is expected that the new height of the bar will be recognized by clinical researchers and result in significantly better design and more powerful studies in the future, the application of this new degree of rigor to studies done in even the recent past must be seen as an attempt to improve medicine, not paralyze it.

Summary of Findings

Question 1: Should interdisciplinary rehabilitation begin during the acute hospitalization for traumatic brain injury?

One small, retrospective, observational study from a single rehabilitation facility supports an association between the acute institution of formalized, multidisciplinary, physiatrist-driven TBI rehabilitation and decreased LOS (acute hospital and acute rehabilitation) and some measures of short-term physiologic (non-cognitive) patient outcome. The level of evidence is Class III. This study concerned patients with severe brain injury (GCS 3-8). There is no evidence from comparative studies for or against early rehabilitation in patients with mild and moderate injury.

Deriving clinical implications from the single Class III study that directly addresses this question must be done with trepidation. It is generally felt that the application of modalities such as physical therapy as early as possible following TBI is beneficial. In addition, the transition from acute stay at the trauma hospital to a rehabilitation facility for severe TBI patients is almost always driven by issues that are peripheral to the proper timing of rehabilitation efforts (e.g., systemic complications, bed availability, etc.). Since the one study did suggest that the institution of formalized, multidisciplinary, physiatrist-driven TBI rehabilitation efforts early in the posttraumatic period was favorably associated with short-term outcome and logistics, it would seem reasonable, based on the present body of literature, to include a physiatrist in the acute care team in as expedient a fashion as possible.

Question 2: Does the intensity of inpatient interdisciplinary rehabilitation affect long-term outcomes?

When measured as the hours of application of individual or group therapies, there is no indication that the intensity of acute-inpatient TBI rehabilitation is related to outcome. Because of methodological weaknesses, however, previous studies are likely to have missed a significant relationship if one exists (a Type II error). These studies contained insufficient information about severity of injury and baseline function to ensure the comparability of the compared groups. These studies also did not consider the quality of individual treatments, their lack of autonomy in the cognitive realm, and the delivery milieu. One or more of these factors might affect the outcome of care more than the time spent in each modality. Therefore, future research into efficacy of acute inpatient TBI rehabilitation must more adequately measure such factors and include them in their predictive models. Future studies also must employ a wider spectrum of outcome measures including measurement of outcomes for a longer period after discharge. Such an analysis would be an ideal application of a universal uniform data set.

With regard to the clinical aspect, the evidence does not support equating different systems of TBI rehabilitation delivery based on equivalent times of patient exposure to various therapeutic modalities. For example, this analysis would not support the assumption that patient benefit would be equal if an equal time spectrum of rehabilitation therapies were delivered at a rehabilitation center as compared with a skilled nursing facility. More detailed analysis of factors involved in predicting response to rehabilitation modalities must be considered in approaching such questions.

Additionally, mandating a minimum number of hours of applied therapy for all TBI patients is not supported by the present state of scientific knowledge. The issues of how much intervention optimizes recovery in a given type of patient remains inadequately studied. It is certainly reasonable to avoid situations in which patients do not receive potentially beneficial treatment. Based on the above studies, however, defining a minimum rehabilitation program in terms of time of applied therapy is not likely to optimize either therapist time or patient recovery. It is probable that a specific basic program will have to be related to individual patient groups. Developing such algorithms requires future research.

Many people who suffer TBI do not enter acute inpatient rehabilitation. Only one study of the effectiveness of inpatient rehabilitation included a comparison group of patients who did not undergo inpatient rehabilitation. Future studies should compare acute, inpatient rehabilitation with commonly used alternatives to inpatient rehabilitation, such as care in a well-staffed, skilled nursing facility or in less intense variations of acute rehabilitation. Very little is known about the outcomes of TBI in these settings.

Question 3: Does the application of compensatory cognitive rehabilitation enhance outcomes for people who sustain TBI?

One small randomized controlled trial (Class I) and one observational study (Class III) provide evidence of the direct effects of compensatory cognitive devices (notebooks, wristwatch alarms, programmed reminder devices) on the reduction of everyday memory failures for people with TBI. A second randomized controlled trial provides evidence that compensatory cognitive rehabilitation reduces anxiety and improves self-concept and interpersonal relationships for people with TBI. The level of evidence is Class II[a].

Two small randomized controlled trials (Class I) provide limited evidence that practice and computer-aided cognitive rehabilitation improve performance on laboratory-based measures of immediate recall. No studies evaluated the link between such cognitive tests and health outcomes, and the associations between performance on cognitive tests and employment in the literature were inconsistent.

Current practice in cognitive rehabilitation lacks a firm basis in experimental clinical studies. It is unlikely that the studies we reviewed, designed to address effectiveness, accurately describe the totality of techniques, stimulation, and human effort and ingenuity that constitute cognitive rehabilitation programs, particularly if the programs are multi- or transdisciplinary. Therapists observe that their patients improve; what is causing the improvements is not understood. In making decisions about the course of treatment, clinicians are compelled to follow their experiences and observations until strong research designs provide evidence from which guidelines and standards can be derived.

Question 4: Does the application of supported employment enhance outcomes for people with TBI?

There is some Class II evidence that supported employment can improve the vocational outcomes of survivors of TBI. Most of the evidence on the effects of supported employment comes from two programs of research, each of which used different experimental designs and different models of supported employment. Both designs used prospective data collection, but one compared the treatment group with an independent control, while the other was a case control study comparing preinjury employment with postinjury employment without and then with supported employment. The findings have not been replicated at other centers, so the results cannot be generalized to the general population of survivors of TBI. Most studies of supported employment in TBI research are of the individual placement model, but some evidence also supports the use of the apprenticeship model.

The evidence for improvement of vocational outcomes with supported employment is sufficient to warrant its use in practice while further research continues. However, much remains unknown about the amount of improvement that is actually gained by these programs and which components of the programs contribute most to the improved outcomes. It also may be important to explore other models of supported employment, like the apprenticeship model or some variations of the work enclave model.

Question 5: Does the provision of long-term care coordination enhance the general functional status of people with TBI?

Very few studies of the effectiveness of case management have been done, and results have been mixed. The clearest demonstration of improvement due to case management is in vocational status, where at least two studies, using different models of case management, showed similar improvements. One of these two programs showed superior results when a single case manager administered all the insurance benefits of each patient; the other showed results in the same direction using a combination of nurse and vocational case manager to select and time the interventions. There were conflicting results on other effects of case management, including disability or functional status, living status, and effects on the family, and some outcomes were mentioned in only one study. The clinical trial, using separate hospital systems randomly assigned to a case management condition, showed that there were no functional status changes among case management participants, despite an extended period of rehabilitation and followup. But, when two forms of case management were compared, both the single and multiple case manager/insurance models showed significant functional improvements.

Although the present evidence is mixed, it seems warranted to continue the use of several case management models to select and time interventions in cases of TBI, and it also may be of benefit to survivors to have the advocacy by the case manager in finding and obtaining treatments. There is a certain face validity to the basic idea of case management, which is simply a matter of careful planning of the choice, sequence, and timing of interventions, and some variation of it is really a standard component of most clinical practice. Also, there probably is some value to the person with TBI of an advocate able to obtain benefits that otherwise would be missed by an unaided survivor. The extent of the benefit of case management, however, remains undemonstrated, and more studies using control groups would be very beneficial in clarifying the actual improvement in outcomes due to case management. It also is unclear whether some models of case management are better than others and for what kinds of clients they might be best suited. These questions contribute to the agenda for future research.

Due to the methods through which the above five topics have been approached in the literature and the relative absence of powerful studies in these areas, the conclusions reached by this evidence-based approach and the clinical implications drawn therefrom are extremely limited. As a direct result, the utility of this document in driving profound alterations in TBI rehabilitation based on the scientific literature is very restricted. Because this report is the product of an exhaustive review of the literature in these five areas, however, we are in an ideal position to be able to summarize the shortcomings of the studies in these fields and to make generalizable recommendations regarding how future efforts could be improved. Since the five topics addressed in this work run the temporal gamut from acute care through long-term survival, this document also serves as an ideal conduit for suggesting the means for optimizing continuity and consistency of research efforts across the spectrum of recovery from TBI. Because the ability to suggest improvements in research efforts in a knowledgeable fashion is probably the most valuable result of this work, special attention was directed to this area. For further information, readers are directed to the analyses of research shortcomings and sets of recommendations presented in the Aspen Consensus Conference proceedings (Chesnut, Alexander, Antoinette, et al., forthcoming).

List of Abbreviations

ADL: Activities of daily living

AHCPR: Agency for Health Care Policy and Research

AIS: Abbreviated injury score

ANCOVA: Analysis of covariance

BVRT: Benton Visual Retention Test

CACR: Computer-aided cognitive rehabilitation

CCR: Compensatory cognitive rehabiliation

CFT: Complex Figure Test

CIQ: Community Integration Questionnaire

CT: Computerized tomography

D/C: Discharge

DRS: Disability rating scale

EMF: Everyday memory failure

EPC: Evidence-based Practice Center

FAM: Functional Adaptability Measure

FIM: Functional Independence Measure

GCS: Glasgow Coma Scale

GOS: Glasgow Outcomes Scale

HCFA: Health Care Financing Administration

ICP: Intracranial pressure

ILP: Independent living programs

ISS: Injury severity scale

KAS: Katz Adjustment Scale

LOS: Length of stay

MANOVA: Multivariable analysis of variance

MAR: Monthly activity ratio

MER: Monthly employment ratio

MMPI: Minnesota Multiphasic Personality Inventory

OHSU: Oregon Health Sciences University

OT: Occupational therapy

PAI: Portland Adaptability Inventory

PASAT: Paced Auditory Serial Addition Task

PT: Physical therapy

PTA: Post-traumatic amnesia

RBMT: Rivermead Behavioral Memory Test

RCR: Restorative cognitive rehabilitation

RCT: Randomized, controlled trial

RKE: Rabideau Kitchen Evaluation

RLA: Ranch Los Amigo

RLAS: Ruff Language Assessment Scale

RT: Reaction time

SRT: Selective Reminding Test

ST: Speech therapy

TBI: Traumatic brain injury

TCDB: Traumatic Coma Data Bank

TEP: Transitional employment program

TLT: Trail Learning Test

VerPa: Verbal Paired Associated Task

VisPa: Visual Paired Associates Task

WAIS: Wechser Adult Intelligence Scale

WMS: Wechser Memory Scale

WRP: Work reentry program

Evidence Tables

Appendix 1. Question Text and Characteristics

Question 1

1. Does the application of early, interdisciplinary rehabilitation improve outcomes for people with traumatic brain injury?

Rationale:

Definitions:

Patient population:

Patient characteristics:

Studies must include or measure:

Outcome measures:

Question 2

2. Does the intensity of inpatient rehabilitation affect outcomes for people with traumatic brain injury?

Rationale:

Definitions:

Intensity--Levels of the intervention vary in intensity based on:

Patient population:

Patient characteristics:

Studies must include or measure:

Outcome measures:

Question 3

3. Does the application of compensatory cognitive rehabilitation enhance outcomes for people who sustain traumatic brain injury?

Rationale:

Definitions:

Patient population:

Patient characteristics:

Outcome measures:

Question 4

4. Does the application of supported employment enhance outcomes for people with traumatic brain injury?

Rationale:

Definitions:

Patient population:

Patient characteristics:

Outcome measures:

Question 5

5. Does the provision of long-term care coordination enhance the general functional status of people with traumatic brain injury? What is the cost-effectiveness of the provision of this intervention?

Rationale:

Definitions:

Patient population:

Patient characteristics:

Outcome measures:

Appendix 2. Search Strings

1. MEDLINE search string

MEDLINE Initial Strategy (Identical for all questions) - 1993 to November 1997

MEDLINE Questions 1 and 2 Strategy

MEDLINE Question 3 Strategy

MEDLINE Question 4 Strategy

Medline Question 5 Strategy

2. HealthSTAR search strings

HealthSTAR strategy (identical for all questions) 1993 to November 1997

3. CINAHL search strings

CINAHL general search strategy (all questions) 1982 to October 1997

4. PyschInfo search string

PsycInfo search strategy (all questions) 1982 to October 1997

5. Current Contents search string

Current Contents search strategy ( all questions) Week 01, 1998 to Week 21, 1998

Appendix 3. Computations of Cohen's Kappa

graphic element

Appendix 4. Initial Abstraction Instrument

Abstraction Instrument, items 1-17
graphic element

Abstraction Instrument, items 18-28
graphic element

Abstraction Instrument, items 29-37
graphic element

Abstraction Instrument, Question #1: Does the Application of Early, Interdisciplinary Rehabilitation Improve Outcomes for Persons With Traumatic Brain Injury? (items 1-7)
graphic element

Abstraction Instrument, Question 1, items 8-12
graphic element

Abstraction Instrument, Question #2: Does the Intensity of In-Patient Rehabilitation Affect Outcomes for Persons With Traumatic Brain Injury? (items 1-5)
graphic element

Abstraction Instrument, Question 2, items 6-11
graphic element

Abstraction Instrument, Question #3: Does the Application of Compensatory Cognitive Rehabilition Enhance Outcomes for Persons Who Sustain Traumatic Brain Injury (items 1-8)
graphic element

Abstraction Instrument, Question 3, items 9-13
graphic element

Abstraction Instrument, Question #4: Does the Application of supported Employment Enhance Outcomes for Persons With Traumatic Brain Injury? (items 1-8)
graphic element

Abstraction Instrument, Question 4, items 9-11
graphic element

Abstraction Instrument, Question #5: Does the Provision of Long-Term Care Coordination Enhance the General Functional Status of Persons With Traumatic Brain Injury? What is the Cost-Effectiveness of the Provision of this Intervention? (items 1-9
graphic element

Abstraction Instrument, Question 5 item 10
graphic element

Appendix 5. Project Personnel

Research Team

  • Principal Investigator

  • Randall M. Chesnut, M.D.

  • Associate Professor of Neurological Surgery

  • Director, Neurotrauma and Neurosurgical Critical Care

  • Oregon Health Sciences University

  • Task Order Manager

  • Nancy Carney, Ph.D.

  • Division of Medical Informatics and Outcomes Research

  • Oregon Health Sciences University

  • N. Clay Mann, Ph.D.

  • Assistant Professor of Emergency Medicine

  • Oregon Health Sciences University

  • Hugo Maynard, Ph.D.

  • Professor of Psychology

  • Portland State University

  • Portland, OR

  • Patricia Patterson, Ph.D.

  • Assistant Professor of Nursing and Medical Informatics

  • and Outcomes Research

  • Oregon Health Sciences University

  • Petronella Davies, M.S.

  • Reference Librarian

  • Oregon Health Sciences University

  • Cynthia Davis-O'Reilly

  • Division of Medical Informatics and Outcomes Research

  • Oregon Health Sciences University

  • Mark C. Hornbrook, Ph.D.

  • Program Director

  • Health Services, Social and Economics Studies

  • Kaiser Permanente Center for Health Research

  • Susan Mahon, M.P.H.

  • Research Associate

  • Division of Medical Informatics and Outcomes Research

  • Oregon Health Sciences University

  • Martie Sucec

  • Senior Technical Writer

  • Kaiser Permanente Center for Health Research

  • James Wallace

  • Operations Director, Outcomes Research

  • Division of Medical Informatics and Outcomes Research

  • Oregon Health Sciences University

  • Melanie Zimmer-Gembeck, Ph.D.

  • Senior Data Analyst

  • Office of Planning and Development

  • Multnomah County Health Department

  • Mark Helfand, M.D., M.P.H.

  • Director, Evidence-Based Practice Center

  • Associate Professor of Internal Medicine and Medical Informatics and Outcomes Research

  • Oregon Health Sciences University

  • Kathryn Pyle Krages, A.M.L.S., M.A.

  • Administrator, Evidence-Based Practice Center

  • Division of Medical Informatics and Outcomes Research

  • Oregon Health Sciences University

National Expert Panel

  • Bryna Helfter, M.A., C.T.R.S.

  • Director, Technical Assistance Center

  • Traumatic Brain Injury State Demonstration Grant Program of Maryland

  • James Kelly, M.D.

  • Director, Brain Injury Program

  • Rehabilitation Institute of Chicago

  • Jeffrey Kreutzer, Ph.D.

  • Director of Rehabilitation Psychology and Neuropsychology

  • Medical College of Virginia

  • Nathan Zasler, M.D.

  • Executive Medical Director, National NeuroRehabilitation Consortium, Inc.

  • Medical Director, Concussion Care Centre of Virginia

Local Expert Panel

  • Robert Brown

  • Survivor

  • Brain Injury Support Group of Portland

  • Carol Christofero-Snider

  • Spouse of Survivor

  • Brain Injury Support Group of Portland

  • Danielle Erb, M.D.

  • Rehabilitation Medicine Associates

  • Molly Hoeflich, M.D.

  • Physiatrist

  • Daniel Irwin

  • Vocational Rehabilitation Division

  • Oregon Department of Human Services

  • Donald Lange, Ph.D.

  • Neuropsychologist

  • Hugo Maynard, Ph.D.

  • Professor of Psychology

  • Portland State University

  • Aimee Mooney, M.S.

  • Rehabilitation Program Coordinator

  • Legacy Rehabilitation Services Community Re-entry Service

  • Meg Munger, R.N., M.S.

  • Rehabilitation Program Coordinator

  • Kaiser Permanente

Reviewers

  • Brian Andrews, M.D., F.A.C.S.

  • San Francisco, CA

  • Representing the American Association of Neurological Surgeons

  • Harriet Udin Aronow, Ph.D.

  • Associate Director of Research

  • Casa Colina Hospital for Rehabilitative Medicine

  • Los Angeles, CA

  • Dawn Bunting, M.S.N., R.N.

  • Plantsville, CT

  • Representing the Association of Rehabilitation Nurses

  • Consensus Development Conference Panel for Rehabilitation of Persons with Traumatic Brain Injury

  • c/o Judith M. Whalen

  • Associate Director for Science Policy, Analysis and Communication

  • National Institute of Child Health and Human Development

  • Bethesda, MD

  • Patricia Goodall

  • VA Department of Rehabilitative Services

  • Richmond, VA

  • Representing the Association for Persons in Supported Employment

  • Richard J. Greenwood, M.D., F.R.C.P.

  • Regional Neurological Rehabilitation Unit

  • Homerton Hospital

  • London, England

  • Candace F. Gustafson, R.N.

  • Burlington, MA

  • Representing the Development Conference Panel for Rehabilitation of Persons with Traumatic Brain Injury

  • Allen Heinemann, Ph.D.

  • Rehabilitation Institute of Chicago

  • Chicago, IL

  • Jess F. Kraus, Ph.D.

  • Southern California Injury Prevention Research Center

  • UCLA School of Public Health

  • Los Angeles, CA

  • Representing the Brain Injury Association

  • Mark Melgard, M.D.

  • Workers Compensation Division

  • Department of Consumer & Business Services

  • State of Oregon

  • Salem, OR

  • Anthony Morgan, M.D., F.A.C.S.

  • Chief of Trauma Services

  • Saint Francis Hospital and Medical Center

  • Hartford, CT

  • Thomas Novack, Ph.D.

  • Spain Rehabilitation Center

  • Birmingham, AL

  • Kristjan T. Ragnarsson, M.D.

  • Department of Rehabilitation Medicine

  • Mount Sinai Medical Center

  • New York, NY

  • Representing the Consensus Development Conference Panel for Rehabilitation of Persons with Traumatic Brain Injury

  • Cheryl Ramandan-Jradi

  • Mercer Island, WA

  • Representing the American Occupational Therapy Association

  • Ronald Ruff, Ph.D.

  • San Francisco Neuropsychology Associates

  • San Francisco, CA

  • Barbara Scheffel, R.N.

  • Scheffel Associates, Inc.

  • Bedminster, NJ

  • Representing the Case Management Association of America

  • Maureen Schmitter-Edgecombe, Ph.D.

  • Department of Psychology

  • Washington State University

  • Pullman, WA

  • Marymargaret Sharp-Pucci, Ed.D., M.P.H.

  • Technology Evaluation Center

  • Blue Cross Blue Shield Association

  • Chicago, IL

  • McKay Moore Sohlberg, Ph.D.

  • Department of Communications Disorders & Sciences

  • University of Oregon

  • Eugene, OR

  • Linda Toms Barker

  • Berkeley Planning Associates

  • Oakland, CA

  • Charles Turkelson, Ph.D.

  • ECRI

  • Plymouth Meeting, PA

  • Dennis A. Turner, M.D.

  • Division of Neurosurgery

  • Duke University Medical Center

  • Durham, NC

  • Professor Barbara Wilson

  • Medical Research Council

  • Applied Psychology Unit

  • Addenbrooke's Hospital

  • Cambridge, England

  • Mark Ylvisaker, Ph.D.

  • Department of Communications Disorders

  • College of Saint Rose

  • Schenectady, NY

  • Nathan Zasler, M.D.

  • Executive Medical Director, NationalNeuroRehabilitation Consortium, Inc.

  • Medical Director, Concussion Care Centre of Virginia

  • Glen Allen, VA

References
Abrams D, Toms Barker L. Enhancing employment success for individuals with traumatic brain injury. Report to Social Security Administration by Sharp Rehabilitation Center, San Diego, CA 1991.
Alberico AM, Ward JD, Choi SC, et al. Outcome after severe head injury. Relationship to mass lesions, diffuse injury, and ICP course in pediatric and adult patients. J Neurosurg. 1987; 67(5): 64856. [PubMed]
Andersen J, Sharkey W, Schwartz ML, et al. Injury severity score, head injury, and patient wait days: Contributions to extended trauma patient length of stay. J Trauma. 1992; 33(2): 21920. [PubMed]
Anderson DC, Bundlie S, Rockswold GL. Multimodality evoked potentials in closed head trauma. Arch Neurol. 1984; 41(4): 36974. [PubMed]
Annoni JM, Beer S, Kesselring J. Severe traumatic brain injury: Epidemiology and outcome after 3 years. Disabil Rehabil. 1992; 14(1): 236. [PubMed]
Aronow HU. Rehabilitation effectiveness with severe brain injury: Translating research into policy. J Head Trauma Rehabil. 1987; 2(3): 2436.
Ashley MJ, Persel CS, Krych DK. Changes in reimbursement climate: Relationship among outcome, cost, and payor type in the postacute rehabilitation environment. J Head Trauma Rehabil. 1993; 8(4): 3047.
Ashley MJL, Krych DK, Persel CS, et al. Post-acute rehabilitation outcome: Relationship to case-management techniques and strategy. J Ins Med. 1994; 26 (3): 34854. [PubMed]
Asikainen I, Kaste M, Sarna S. Patients wtih with traumatic brain injury referred to a rehabilitation and re-employment programme: Social and professional outcome for 508 Finnish patients 5 or more years after injury. Brain Inj. 1996; 10(12): 88399. [PubMed]
Basso A, Capitani E, Vignolo LA. Influence of rehabilitation on language skills in aphasic patients: A controlled study. Arch Neurol. 1979; 36(4): 1906. [PubMed]
Batchelor J, Shores EA, Marosszeky JE, et al. Cognitive rehabilitation of severely closed-head-injured patients using computer-assisted and noncomputerized treatment techniques. J Head Trauma Rehabil. 1988; 3(3): 7885.
Ben-Yishay Y, Silver S, Plasetsky E, et al. Relationship between employability and vocational outcome after intensive holistic cognitive rehabilitation. J Head Trauma Rehabil. 1987; 2(1): 3548.
Bergman TA, Rockswold GL, Haines SJ, et al. Outcome of severe closed head injury in the Midwest. A review and comparison with other major head trauma studies. Minn Med. 1987; 70(7): 397401. [PubMed]
Bishara SN, Partridge FM, Godfrey HP, et al. Post-traumatic amnesia and Glasgow Coma Scale related to outcome in survivors in a consecutive series of patients with severe closed-head injury. Brain Inj. 1992; 6(4): 37380. [PubMed]
Blackerby WF. Intensity of rehabilitation and length of stay. Brain Inj. 1990; 4(2): 16773. [PubMed]
Bond MR. The stages of recovery from severe head injury with special reference to late outcome. Int Rehabil Med. 1979; 1(4): 1559. [PubMed]
Born JD, Albert A, Hans P, et al. Relative prognostic value of best motor response and brain stem reflexes in patients with severe head injury. Neurosurgery. 1985; 16(5): 595601. [PubMed]
Bowers SA, Marshall LF. Outcome in 200 consecutive cases of severe head injury treated in San Diego County: A prospective analysis. Neurosurgery. 1980; 6(3): 23742. [PubMed]
Braakman R, Gelpke GJ, Habbema JD, et al. Systematic selection of prognostic features in patients with severe head injury. Neurosurgery. 1980; 6(4): 36270. [PubMed]
Brooks N, Campsie L, Symington C, et al. The five-year outcome of severe blunt head injury: A relative's view. J Neurol Neurosurg Psychiatry. 1986; 49: 76470. [PubMed]
Brooks N, McKinlay W, Symington C, et al. Return to work within the first seven years of severe head injury. Brain Inj. 1987; 1(1): 519. [PubMed]
Bullock R, Chesnut R, Clifton G, et al. Guidelines for the management of severe head injury. Revision 1. New York:Brain Trauma Foundation; 1998.
Carey RG, Seibert JH, Posavac EJ. Who makes the most progress in inpatient rehabilitation? An analysis of functional gain. Arch Phys Med Rehabil. 1988; 69(5): 33743. [PubMed]
Carnevale GJ. Natural-setting behavior management for individuals with traumatic brain injury: Results of a three-year caregiver training program. J Head Trauma Rehabil. 1996; 11(1): 2738.
Cavallo MM, Kay T, Ezrachi O. Problems and changes after traumatic brain injury: Differing perceptions within and between families. Brain Inj. 1992; 6(4): 32735. [PubMed]
Centers for Disease Control and Prevention. Unpublished data from the National Center for Injury Prevention and Control. Personal communication from David Thurman. May 1998.
Chan L, Koepsell TD, Deyo RA, et al. The effect of Medicare's payment system for rehabilitation hospitals on length of stay, charges, and total payments. N Engl J Med. 1997; 337: 97885. [PubMed]
Chelimsky ESW, Shadish W, editors. Evaluation for the 21st century: A handbook. Thousand Oaks, CA: Sage Publications; 1997.
Chesnut RM, Alexander D, Antoinette T, et al. Toward an integrated approach to quantitative research on the rehabilitation of patients with TBI: A call for consensus formation of a universal, uniform data set. Forthcoming.
Chesnut RM, Marshall LF, Klauber MR, et al. The role of secondary brain injury in determining outcome from severe head injury. J Trauma. 1993; 34(2): 21622. [PubMed]
Chesnut RM, Marshall SB, Piek J, et al. Early and late systemic hypotension as a frequent and fundamental source of cerebral ischemia following severe brain injury in the Traumatic Coma Data Bank. Acta Neurochir Suppl. 1993; 59: 1215. [PubMed]
Choi SC, Narayan RK, Anderson RL, et al. Enhanced specificity of prognosis in severe head injury. J Neurosurg. 1988; 69(3): 3815. [PubMed]
Cicerone KD, Smith LC, Ellmo W, et al. Neuropsychological rehabilitation of mild traumatic brain injury. Brain Inj. 1996; 10: 27786. [PubMed]
Cifu DX, Kreutzer JS, Marwitz JH, et al. Functional outcomes of older adults with traumatic brain injury: A prospective, multicenter analysis. Arch Phys Med Rehabil. 1996; 77(9): 8838. [PubMed]
Cifu DX, Keyser-Marcus L, Lopez E, et al. Acute predictors of successful return to work 1 year after traumatic brain injury: A multicenter analysis. Arch Phys Med Rehabil. 1997; 78(2): 12531. [PubMed]
Coelho CA, DeRuyter F, Stein M. Treatment efficacy: Cognitive-communicative disorders resulting from traumatic brain injury in adults. J Speech Hear Res. 1996; 39(5): S517. [PubMed]
Commission for Case Manager Certification. CCM certification guide: Certified Case Manager. Rolling Meadows, IL: Commission for Case Manager Certification; 1996.
Cope DN. The effectiveness of traumatic brain injury rehabilation rehabilitation: A review. Brain Inj. 1995; 9: 64970. [PubMed]
Cope DN, Cole JR, Hall KM, et al. Brain injury: Analysis of outcome in a post-acute rehabilitation system. Part 2: Subanalyses. [see comments]. Brain Inj. 1991; 5(2): 12739. [PubMed]
Cope DN, Hall K. Head injury rehabilitation: Benefit of early intervention. Arch Phys Med Rehabil. 1982; 63(9): 4337. [PubMed]
Corrigan JD, Bogner JA, Mysiw WJ, et al. Systematic bias in outcome studies of persons with traumatic brain injury. Arch Phys Med Rehabil. 1997; 78(2): 1327. [PubMed]
Courtney C. A model for community support and case coordination networks for persons with traumatic brain injury. Final report submitted to Rehabilitation Services Administration, CSDA #84.235, Award H128A91121. St Paul: State of Minnesota Department of Jobs and Training, Division of Rehabilitation Services and Minnesota Head Injury Association; 1992.
Cowen TD, Meythaler JM, DeVivo MJ, et al. Influence of early variables in traumatic brain injury on functional independence measure scores and rehabilitation length of stay and charges. Arch Phys Med Rehabil. 1995; 76(9): 797803. [PubMed]
Crepeau F, Scherzer P. Predictors and indicators of work status after traumatic brain injury: A meta-analysis. Neuropsychol Rehabil. 1993; 3(1): 535.
Curl RM, Chisholm LA. Unlocking coworker potential in competitive employment: Keys to a cooperative approach. J Vocational Rehabil. 1993; 3(3): 7284.
Curl RM, Fraser RT, Cook RG, et al. Traumatic brain injury vocational rehabilitation: preliminary findings for the coworker as trainer project. J Head Trauma Rehabil. 1996; 11(1): 7585.
David R, Enderby P, Bainton D. Treatment of acquired aphasia: Speech therapists and volunteers compared. J Neurol Neurosurg Psychiatry. 1982; 45(11): 95761. [PubMed]
Dawson DR, Chipman M. The disablement experienced by traumatically brain-injured adults living in the community. Brain Inj. 1995; 9(4): 33953. [PubMed]
Deacon D, Campbell K. Decision making following closed head injury: Can response speed be trained? J Clin Exp Neuropsychol. 1991; 13: 63951. [PubMed]
Devany CW, Kreutzer JS, Halberstadt LJ, et al. Referrals for supported employment after brain injury: Neuropsychological, behavioral, and emotional characteristics. J Head Trauma Rehabil. 1991; 6(3): 5970.
Dikmen S, Machamer J, Temkin N. Psychosocial outcome in patients with moderate to severe head injury: 2-year follow-up. Brain Inj. 1993; 7(2): 11324. [PubMed]
Dikmen S, Reitan RM, Temkin NR. Neuropsychological recovery in head injury. Arch Neurol. 1983; 40(6): 3338. [PubMed]
Dikmen SS, Temkin NR, Machamer JE, et al. Employment following traumatic head injuries. Arch Neurol. 1994; 51(2): 17786. [PubMed]
Dombovy ML, Olek AC. Recovery and rehabilitation following traumatic brain injury. Brain Inj. 1997; 11(5): 30518. [PubMed]
Dresser AC, Meirowsky AM, Weiss GH, et al. Gainful employment following head injury. Prognostic factors. Arch Neurol. 1973; 29(2): 1116. [PubMed]
Eames P, Cotterill G, Kneale TA, et al. Outcome of intensive rehabilitation after severe brain injury: A long-term follow-up study. Brain Inj. 1996; 10(9): 63150. [PubMed]
Eames P, Wood R. Rehabilitation after severe brain injury: A follow-up study of a behaviour modification approach. J Neurol Neurosurg Psychiatry. 1985; 48(7): 6139. [PubMed]
Edna TH, Cappelen J. Return to work and social adjustment after traumatic head injury. Acta Neurochir. 1987; 85(1-2): 403. [PubMed]
Eliason MR, Topp BW. Predictive validity of Rappaport's Disability Rating Scale in subjects with acute brain dysfunction. Phys Ther. 1984; 64(9): 135760. [PubMed]
Ellerd DA, Moore SC. Follow-up at twelve and thirty months of persons with traumatic brain injury engaged in supported employment placements. J Appl Rehabil Couns. 1992; 23(3): 4850.
Evans R, Ruff RM. Outcome and value: A perspective on rehabilitation outcomes achieved in acquired brain injury. J Head Trauma Rehabil. 1992; 7(4): 2436.
Evans RW, Watke M. Catastrophic neurologic injury: Improving outcomes through case management. Case Manager. 1995; 6(3): 835, 87-8.
Ewing CL, Thomas DJ, Sansces A, et al. Impact of injury of the head and spine. Springfield, IL: Thomas; 1983.
Ezrachi O, Ben-Yishay Y, Kay T, et al. Predicting employment in traumatic brain injury following neuropsychological rehabilitation. J Head Trauma Rehabil. 1991; 6: 7184.
Fabiano RJ, Crewe N. Variables associated with employment following severe traumatic brain injury. Rehabil Psychol. 1995; 40: 22331.
Fairweather G, Sanders DL, Maynard H, et al. Community life for the mentally ill: An experiment in social innovation. Chicago: Aldine; 1969.
Fearnside MR, Cook RJ, McDougall P, et al. The Westmead Head Injury Project. Physical and social outcomes following severe head injury. Br J Neurosurg. 1993; 7(6): 64350. [PubMed]
Fiedler RC, Granger CV. Uniform data system for medical rehabilitation: report of first admissions for 1995. Am J Phys Med Rehabil. 1997; 76(1): 7681. [PubMed]
Fraser R, Dikmen S, McLean A, et al. Employability of head injury survivors: First year post-injury. Special issue: Traumatic brain injury. Rehabil Couns Bull. 1988; 31(4): 276288.
Fryer LJ, Haffer WJ. Cognitive rehabilitation and community readaption: Outcomes from two program models. J Head Trauma Rehabil. 1987; 2: 5163.
Gerber L. Case management models: Geriatric nursing prototypes for growth. J Gerontol Nurs. 1994; 20(7): 1824. [PubMed]
Giacino JT, Kezmarsky MA, DeLuca J, et al. Monitoring rate of recovery to predict outcome in minimally responsive patients. Arch Phys Med Rehabil. 1991; 72(11): 897901. [PubMed]
Girard D, Brown J, Burnett-Stolnack M, et al. The relationship of neuropsychological status and productive outcomes following traumatic brain injury. Brain Inj. 1996; 10: 66376. [PubMed]
Godfrey H, Knight R, Bishara S. The relationship between social skill and family problem-solving following very severe closed head injury. Brain Inj. 1991; 5(2): 20711. [PubMed]
Goering PNW,[Wasylenki DA,] Farkas M, Lancee WJ, et al. What difference does case management make? Hosp Community Psychiatry. 1988; 39(3): 2726. [PubMed]
Goldstein K. The organism: A holistic approach to biology derived from pathological data in man. New York: Urzone; 1995.
Goldstein G, McCue M, Turner S, et al. An efficacy study of memory training for patients with closed-head injury. Clin Neuropsychologist. 1988; 2: 2519.
Goodwin D. Nursing case management activities: How they differ between employment settings. J Nurs Adm. 1994; 24(2): 2934. [PubMed]
Gopinath SP, Robertson CS, Contant CF, et al. Jugular venous desaturation and outcome after head injury. J Neurol Neurosurg Psychiatry. 1994; 57(6): 71723. [PubMed]
Gouvier WD, Blanton PD, LaPorte KK, et al. Reliability and validity of the Disability Rating Scale and the Levels of Cognitive Functioning Scale in monitoring recovery from severe head injury. Arch Phys Med Rehabil. 1987; 68(2): 947. [PubMed]
Granger CV, Hamilton BB, Sherwin FS. Guide for use of the uniform data set for medical rehabilitation. Buffalo, NY: Uniform Data System for Medical Rehabilitation; 1986.
Gray JM, Robertson I, Pentland B. Microcomputer-based attentional retraining after brain damage: A randomised group controlled trial. Neuropsychol Rehabil. 1992; 2(2): 97115.
Greenspan AI, Wrigley JM, Kresnow M, Fine PR et al. Factors influencing failure to return to work due to traumatic brain injury. Brain Inj. 1996; 10(3): 20718. [PubMed]
Greenwood RJM, Brooks DN. Effects of case management after severe head injury. BMJ. 1994; 308: 11991205. [PubMed]
Gronwall D. Paced auditory serial-addition task: A measure of recovery from concussion. Percept Mot Skills. 1977; 44: 36773. [PubMed]
Gronwall D. Rehabilitation programs for patients with mild head injury: Components, problems, and evaluation. J Head Trauma Rehabil. 1986; 1(2): 5362.
Gronwall D, Wrightson P. Duration of post-traumatic amnesia after mild head injury. J Clin Neuropsychol. 1980; 2(1): 25160.
Haffey WJ, Abrams DL. Employment outcomes for participants in a brain injury work reentry program: Preliminary findings. J Head Trauma Rehabil. 1991; 6(3): 2434.
Hagen C, Malkmus D, Durham P, et al. Levels of cognitive functioning. Rehabilitation of the head injured adult. Comprehensive physical management. Downey, CA: Professional Staff Association, Rancho Los Amigos Hospital; 1979.
Hall K, Cope DN, Rappaport M. Glasgow Outcome Scale and Disability Rating Scale: Comparative usefulness in following recovery in traumatic head injury. Arch Phys Med Rehabil. 1985; 66(1): 357. [PubMed]
Hall KM, Cope DN. The benefit of rehabilitation in traumatic brain injury: A literature review. J Head Trauma Rehabil. 1995; 10(1): 113.
Hall KM, Mann N, High WM, et al. Functional measures after traumatic brain injury: Ceiling effects of FIM, FIM+FAM, DRS, and CIQ. J Head Trauma Rehabil. 1996; 11(5): 2739.
Hawkins ML, Lewis FD, Medeiros RS. Serious traumatic brain injury: An evaluation of functional outcomes. J Trauma. 1996; 41(2): 25763; discussion 263-4. [PubMed]
Heinemann AW, Hamilton B, Linacre JM, et al. Functional status and therapeutic intensity during inpatient rehabilitation. Am J Phys Med Rehabil. 1995; 74(4): 31526. [PubMed]
Heinemann AW, Sabgal V, Cichowski K, et al. Functional outcomes following traumatic brain injury. J Neurol Rehabil. 1990; 4: 2737.
Helffenstein D, Wechsier R. The use of interpersonal process recall (PR) in the remediation of interpersonal and communication skill deficits in the newly brain injured. Clin Neuropsychol. 1982; 4: 13943.
Hendryx P. Psychosocial changes perceived by closed-head-injured adults and their families. Arch Phys Med Rehabil. 1989; (70): 52630. [PubMed]
High WM Jr, Boake C, Lehmkuhl LD. Critical analysis of studies evaluating the effectiveness of rehabilitation after traumatic head injury. J Head Trauma Rehabil. 1995; 10(1): 1426.
High WM Jr, Hall KM, Rosenthal M, et al. Factors affecting hospital length of stay and charges following traumatic brain injury of injured adults living in the community. Brain Inj. 1996; 9(4): 33953.
Ip RY, Dornan J, Schentag C. Traumatic brain injury: factors predicting return to work or school. Brain Inj. 1995; 9: 51732. [PubMed]
Jacobs HE. The Los Angeles Head Injury Survey: Procedures and initial findings. Arch Phys Med Rehabil. 1988; 69(6): 42531. [PubMed]
Jennett B, Bond M. Assessment of outcome after severe brain damage: A practical scale. Lancet. 1975: 14804.
Jennett B, Snoek J, Bond MR, et al. Disability after severe head injury: Observations of the use of the Glasgow Outcome Scale. J Neurol Neurosurg Psychiatry. 1981; 44(4): 28593. [PubMed]
Jennett B, Teasdale G, Galbraith S, et al. Prognosis in patients with severe head injury. Acta Neurochir Suppl. 1979; 28(1): 14952. [PubMed]
Johnson D, Roethig-Johnston K. Head injury: Early rehabilitation of head-injured patients. Nurs Times. 1989; 85(4): 258. [PubMed]
Johnson R. Return to work after severe head injury. Int Disabil Studies. 1987; 9: 4954. [PubMed]
Johnston MV. Outcomes of community re-entry programmes for brain injury survivors. Part 2: Further investigations [see comments]. Brain Inj. 1991; 5(2): 15568. [PubMed]
Johnston MV, Hall K. Outcomes evaluation in TBI rehabilitation Part I: Overview and system principles. Arch Phys Med Rehabil. 1994; 75: SC2SC28.
Johnston MV, Lewis FD. Outcomes of community re-entry programmes for brain injury survivors. Part 1: Independent living and productive activities. Brain Injury. 1991; 5(2): 14154. [PubMed]
Jones C. Outcome following closed head injury. J Neurosurg Nurs. 1981; 13(4): 17883. [PubMed]
Jones ML, Evans RW. Outcome validation in post-acute rehabilitation: Trends and correlates in treament and outcome. J Ins Med. 1992; 24(3): 18692. [PubMed]
Jones PA, Andrews PJ, Midgley S, et al. Measuring the burden of secondary insults in head-injured patients during intensive care. J Neurosurg Anesth. 1994; 6(1): 414. [PubMed]
Jorgensen HS. Hospital rehabilitation of patients with severe brain injuries. II.Prognosis and effect of early intensive, specialized rehabilitation. Ugeskr Laeger. 1997; 159(26): 40939. [PubMed]
Kaitaro T, Koskinen S, Kaipio ML. Neurophysiological problems in everyday life: A 5-year follow-up study of young severely closed-head-injured patients. Brain Inj. 1995; 9(7): 71327. [PubMed]
Kerner MJ, Acker M. Computer delivery of memory retraining with head injured patients. Cogn Rehabil. 1985; Nov-Dec: 2631.
Klauber MR, Marshall LF, Luerssen TG, et al. Determinants of head injury mortality: Importance of the low risk patient. Neurosurgery. 1989; 24(1): 316. [PubMed]
Kock C, Fuhrmann R. [Early neurologic rehabilitation--an urgent requirement] [German]. Rehabilitation. 1992; 31(4): 2179. [PubMed]
Kosubek C, Feldmann M, Schwendemann G. Early neurological rehabilitation. Local demand for early rehabilitation places for adult patients illustrated for the Land Bremen[Early neurologic-neurosurgical rehabilitation--on the epidemiology of the need for early rehabilitation beds by adult patients exemplified by the Bremen federal district][German]. Rehabilitation (Stuttgart). 1996; 35(1): 2932. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
Kozloff R. Networks of social support and the outcome from severe head injury. J Head Trauma Rehabil. 1987; 2(3): 1423.
Kraft JF, Schwab KA, Salazar AM, et al. Occupational and educational achievements of head injured Vietnam veterans at 15-year follow-up. Arch Phys Med Rehabil. 1993; 74(6): 596601. [PubMed]
Kraus J, Sorenson S. Epidemiology. In Silver JM, Yudofsky SC, Hales RE, editors, Neuropsychiatry of traumatic brain injury. Washington, DC: American Psychiatric Press; 1994.
Kraus JF, McArthur DL. Epidemiologic aspects of brain injury. Neurologic Clinics. 1996; 14(2): 43550. [PubMed]
Kreutzer J, Wehman P, Morton MV, et al. Supported employment and compensatory strategies for enhancing vocational outcome following traumatic brain injury. Brain Inj. 1988; 2(3): 20523. [PubMed]
Kreutzer JS, Doherty R, Harris JA. Alcohol abuse among persons with traumatic brain injury. J Head Trauma Rehabil. 1990; 5: 920.
Kreutzer JS, Marwitz JH, Kepler K. Traumatic brain injury: Family response and outcome. Arch Phys Med Rehabil. 1992; 73(8): 7718. [PubMed]
Kwasnica CM, Heinemann A. Coping with traumatic brain injury: Representative case studies. Arch Phys Med Rehabil. 1994; 75(4): 3849. [PubMed]
Leathem J, Heath E, Woolley C. Relatives' perceptions of role change, social support and stress after traumatic brain injury. Brain Inj. 1996; 10(1): 2738. [PubMed]
Lehmkulh LD, Hall KM, Mann N, et al. Factors that influence costs and length of stay in persons with traumatic brain injury in acute care and inpatient rehabilitation. J Head Trauma Rehabil. 1993; 8(2): 88100.
Levin HS, Benton AL, Grossman RG. Neurobehavioral consequences of closed head injury. New York: Oxford University Press; 1982.
Levin HS, Gary HE Jr, Eisenberg HM, et al. Neurobehavioral outcome 1 year after severe head injury. Experience of the Traumatic Coma Data Bank. J Neurosurg. 1990; 73(5): 699709. [PubMed]
Levin HS, O'Donnell VM, Grossman RG. The Galveston Orientation and Amnesia Test. A practical scale to assess cognition after head injury. J Nerv Ment Dis. 1979; 167(11): 67584. [PubMed]
Lewin ICF. The cost of disorders of the brain. Washington, DC: National Foundation for the Brain; 1992.
Lezak MD. Assessment for rehabilitation planning. In Meier M, Benton AL, Diller L, Neuropsychological rehabilitation. New York: Guilford Press; 1987.
Lezak MD. Neuropsychological assessment. New York: Oxford University Press; 1995.
Livingston MG, Brooks DN, Bond MR. Patient outcome in the year following severe head injury and relatives' psychiatric and social functioning. J Neurol Neurosurg Psychiatry. 1985; 48: 87681. [PubMed]
Lomas J, Kertesz A. Patterns of spontaneous recovery in aphasic groups: A study of adult stroke patients. Brain Lang. 1978; 5(3): 388401. [PubMed]
Mackay LE, Bernstein BA, Chapman PE, et al. Early intervention in severe head injury: Long-term benefits of a formalized program. Arch Phys Med Rehabil. 1992; 73(7): 63541. [PubMed]
Malec JF, Buffington AL, Moessner AM, et al. Maximizing vocational outcome after brain injury: Integration of medical and vocational hospital-based services. Mayo Clin Proc. 1995; 70(12): 116571. [PubMed]
Malec JF, Smigielski JS, DePompolo RW, et al. Outcome evaluation and prediction in a comprehensive-integrated post-acute outpatient brain injury rehabilitation programme. Brain Inj. 1993; 7(1): 1529. [PubMed]
Marion DW, editor. Traumatic brain injury. New York: Thieme; 1999; pp.121-2.
Marion DW, Carlier PM. Problems with initial Glasgow Coma Scale assessment caused by prehospital treatment of patients with head injuries: Results of a national survey. J Trauma. 1994; 36(1): 8995. [PubMed]
Marmarou A, Anderson RL, Ward JD, et al. Impact of ICP instability and hypotension on outcome in patients with severe head trauma. J Neurosurg. 1991; 75(Suppl): S15966.
Marshall LF, Bowers-Marshall S, Klauber MR, et al. A new classification of head injury based on computerized tomography. J Neurosurg. 1991; 75(Suppl): S1420.
Marshall LF, Gautille T, Klauber MR, et al. The outcome of severe head injury. J Neurosurg. 1991; 75(Suppl): S2836.
Maslow A. Motivation and personality, 3rd edition. Harper & Row: New York; 1987.
Mayer T, Walker ML, Shasha I, et al. Effect of multiple trauma on outcome of pediatric patients with neurologic injuries. Childs Brain. 1981; 8(3): 18997. [PubMed]
McLaughlin AM, Peters S. Evaluation of an innovative cost-effective programme for brain injury patients: Response to a need for flexible treatment planning. Brain Inj. 1993; 7(1): 715. [PubMed]
McMillan TMG, Morris JR, Brooks DN, et al. An introduction to the concept of head injury case mangement with respect to the need for service provision. Clin Rehabil. 1988; 2: 31922.
McMordie WR, Barker SL. The financial trauma of head injury. Brain Inj. 1988; 2(4): 35764. [PubMed]
Middleton DK, Lambert MJ, Seggar LB. Neuropsychological rehabilitation: microcomputer-assisted treatment of brain-injured adults. Percept Mot Skills. 1991; 72: 52730. [PubMed]
Mills VM, Nesbeda T, Katz DI, et al. Outcomes for traumatically brain-injured patients following post-acute rehabilitation programmes. Brain Inj. 1992; 6(3): 21928. [PubMed]
Morgan AS, Chapman P, Tokarski L. Improved care of the traumatically brain injured. Presented at Eastern Association for Surgery of Trauma. First Annual Conference; January 15, 1988; Longboat Key, FL.
Morton MV, Wehman P. Psychosocial and emotional sequelae of individuals with traumatic brain injury: A literature review and recommendations. Brain Inj. 1995; 9(1): 8192. [PubMed]
Najenson T, Groswasser Z, Mendelson L, et al. Rehabilitation outcome of brain damaged patients after severe head injury. Int Rehabil Med. 1980; 2(1): 1722. [PubMed]
Neistadt ME. Occupational therapy treatments for constructional deficits. Am J Occup Ther. 1992; 46(2): 1418. [PubMed]
Niemann H, Ruff RM, Baser CA. Computer-assisted attention retraining in head-injured individuals: A controlled efficacy study of an outpatient program. J Consult Clin Psychol. 1990; 58(6): 8117. [PubMed]
Novack TA, Caldwell SG, Duke LW, et al. Focused versus unstructured intervention for attention deficits after traumatic brain injury. J Head Trauma Rehabil. 1996; 11(3): 5260.
Oddy M, Humphrey M. Social recovery during the year following severe head injury. J Neurol Neurosurg Psychiatry. 1980; 43(9): 798802. [PubMed]
Olver JH, Ponsford JL, Curran CA. Outcome following traumatic brain injury: A comparison between 2 and 5 years after injury. Brain Inj. 1996; 10(11): 8418. [PubMed]
Ommaya AK, Salazar AM, Dannenberg AL et al. Outcome after traumatic brain injury in the U.S. military medical system. J Trauma. 1996; 41(6): 9725. [PubMed]
Ostby S, Sakata R, Leung P. Perceived persistence of problems in post-head-injury rehabilitation. Brain Inj. 1991; 5(1): 916. [PubMed]
Panikoff LB. Recovery trends of functional skills in the head-injured adult. Am J Occup Ther. 1983; 37(11): 73543. [PubMed]
Panting AM, Merry PH. Long term rehabilitation of severe head injuries with particular reference to need for social and medical support for the patient's family. Rehabilitation. 1972: 82337.
Partridge TM. An investigation into the vocational rehabilitation practices provided by brain injury services throughout the United Kingdom. Work. 1996; 7: 6372.
Pazzaglia P, Frank G, Frank F, et al. Clinical course and prognosis of acute post-traumatic coma. J Neurol Neurosurg Psychiatry. 1975; 38(2): 14954. [PubMed]
Pentland B, Miller JD. Head injury rehabilitation in Edinburgh. Health Bull. 1986; 44(2): 1059. [PubMed]
Peters MD, Gluck M, McCormick M. Behaviour rehabilitation of the challenging client in less restrictive settings. Brain Inj. 1992; 6(4): 299314. [PubMed]
Pettifer S. Leisure as compensation for employment and unfulfilling work: Reality or pipedream. J Occupational Sci. 1993; 1(2): 208.
Ponsford JL, Kinsella G. Evaluation of a remedial programme for attentional deficits following closed-head injury. J Clin Exp Neuropsychol. 1988; 10(6): 693708. [PubMed]
Ponsford JL, Olver JH, Curran C. A profile of outcome: 2 years after traumatic brain injury. Brain Inj. 1995; 9(1): 110. [PubMed]
Powell T, Pancsofar EL, Steere KE, et al. Supported employment: Providing integrated employment opportunities for persons with disabilities. New York: Longman; 1991.
Prigatano G. Neuropsychological rehabilitation of the traumatically brain injured. Baltimore: Johns Hopkins University Press; 1986.
Prigatano GP, Fordyce DJ, Zeiner HK, et al. Neuropsychological rehabilitation after closed head injury in young adults. J Neurol Neurosurg Psychiatry. 1984; 47(5): 50513. [PubMed]
Ragnarsson KT, Thomas JP, Zasler ND. Model systems of care for individuals with traumatic brain injury. J Head Trauma Rehabil. 1993; 8(2): 111.
Rao N, Kilgore KM. Predicting return to work in traumatic brain injury using assessment scales. Arch Phys Med Rehabil. 1992; 73(10): 9116. [PubMed]
Rappaport M, Hall KM, Hopkins K, et al. Disability rating scale for severe head trauma: Coma to community. Arch Phys Med Rehabil. 1982; 63(3): 11823. [PubMed]
Rappaport M, Herrero-Backe C, Rappaport ML, et al. Head injury outcome up to ten years later. Arch Phys Med Rehabil. 1989; 70(13): 88592. [PubMed]
Reeder KP, Rosenthal M, Lichtenberg P, et al. Impact of age on functional outcome following traumatic brain injury. J Head Trauma Rehabil. 1996; 11(3): 2231.
Resnick C. The effect of head injury on family and marital stability. Soc Work Health Care. 1993; 18(2): 4962. [PubMed]
Robertson CS, Contant CF, Gokaslan ZL, et al. Cerebral blood flow, arteriovenous oxygen difference, and outcome in head injured patients. J Neurol Neurosurg Psychiatry. 1992; 55(7): 594603. [PubMed]
Roe A. The psychology of occupations. New York: Wiley; 1956.
Roessler R, Schriner K, Price P. Employment concerns of people with head injuries. J Rehabil. 1992; 58: 1722.
Rosenbaum MNT, Najenson T. Changes in life patterns and symptoms of low mood as reported by wives of severely injured soldiers. J Consult Clin Psychol. 1976; 44(6): 8818. [PubMed]
Rosenthal M, Young T. Effective family intervention after traumatic brain injury: Theory and practice. J Head Trauma Rehabil. 1988; 3(4): 4250.
Ruff RM, Niemann H. Cognitive rehabilitation versus day treatment in head-injured adults: Is there an impact on emotional and psychosocial adjustment? Brain Inj. 1990; 4(4): 33947. [PubMed]
Ruff RM, Baser CA, Johnston JW, et al. Neuropsychological rehabilitation: An experimental study with head-injured patients. J Head Trauma Rehabil. 1989; 4(3): 2036. [PubMed]
Ruff R, Mahaffey R, Engel J, et al. Efficacy study of THINKable in the attention and memory retraining of traumatically head-injured patients. Brain Inj. 1994; 8: 314. [PubMed]
Ruff RM, Marshall LF, Crouch J, et al. Predictors of outcome following severe head trauma: Follow-up data from the Traumatic Coma Data Bank. Brain Inj. 1993; 7(2): 10111. [PubMed]
Ruff RM, Marshall LF, Klauber MR, et al. Alcohol abuse and neurological outcome of the severely head injured. J Head Trauma Rehabil. 1990; 5: 2131.
Rusk HA, Block JM, Lowman EW. Rehabilitation following traumatic brain damage; Immediate and long-term follow-up results in 127 cases. Med Clin North Am. 1969; 53(3): 67784. [PubMed]
Russell WR. Cerebral involvement in head injury. Brain. 1932; 55: 549603.
Russell WR. Amnesia following head injuries. Lancet. 1935; 2: 7623.
Russell WR, Nathan PW. Traumatic amnesias. Brain. 1946; 69: 280301.
Russell WR, Smith A. Post-traumatic amnesia in closed head injury. Arch Neurol. 1961; 5: 417. [PubMed]
Ryan T, Ruff R. The effect of structured memory retraining in a group comparison of head trauma patients. Arch Clin Neuropsychol. 1988; 3: 16579. [PubMed]
Sakata R, Ostby S, Leung P. Functional status, referral and cost of treatment for persons with traumatic head injury. Brain Inj. 1991; 5(4): 4119. [PubMed]
Sale P, West M, Sherron P, et al. Exploratory analysis of job separations from supported employment for persons with traumatic brain injury. J Head Trauma Rehabil. 1991; 6(3): 111.
Sample PRA, Rowntree AJ. Employment intervention strategies for individuals with brain injury. Occup Ther Health Care. 1995; 9(1): 4556.
Sander AM, Kreutzer JS, Rosenthal M, et al. A multicenter longitudinal investigation of return to work and community integration following traumatic brain injury. J Head Trauma Rehabil. 1996; 11(5): 7084.
Saneda DL, Corrigan JD. Predicting clearing of post-traumatic amnesia following closed-head injury. Brain Inj. 1992; 6(2): 16774. [PubMed]
Sanguinetti M, Catanzaro M. A comparison of discharge teaching on the consequences of brain injury. J Neurosci Nurs. 1987; 19(5): 2715. [PubMed]
Sarno MT. The status of research in recovery from aphasia. In Lebrun Y, Hoops R, editors, Recovery in aphasics. Amsterdam: Swets and Zeitlinger; 1976.
Sbordone R, Liter J, Pettler-Jennings P. Recovery of function following severe traumatic brain injury: A retrospective 10-year follow-up. Brain Inj. 1995; 9(3): 28599. [PubMed]
Schalen WN, Nordstrom G, Nordstrom CH. Economic aspects of capacity for work after severe traumatic brain lesions. Brain Inj. 1994; 8(1): 3747. [PubMed]
Scherzer BP. Rehabilitation following severe head trauma: results of a three-year program. Arch Phys Med Rehabil. 1986; 67(6): 36674. [PubMed]
Schmitter-Edgecombe M, Fahy JF, Whelan JP, et al. Memory remediation after severe closed head injury: Notebook training versus supportive therapy. J Consult Clin Psychol. 1995; 63(3): 4849. [PubMed]
Schwab K, Grafman J, Salazar AM, et al. Residual impairments and work status 15 years after penetrating head injury: Report from the Vietnam Head Injury Study. Neurology. 1993; 43(1): 95103. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
Shepherd G. Psychological disorder and unemployment. Bull Br Psychol Soc. 1981; 34: 3458.
Sherburne E. A rehabilitation protocol for the neuroscience intensive care unit. J Neurosci Nurs. 1986; 18(3): 1405. [PubMed]
Sohlberg M, Mateer C. Introduction to cognitive rehabilitation, theory and practice. New York: Guilford Press; 1989.
Sosin DM, Sniezek JE, Waxweiler RJ. Trends in death associated with traumatic brain injury, 1979 through 1992. Success and failure. JAMA. 1995; 273: 177880. [PubMed]
Sparadeo FR, Gill D. Effects of prior alcohol use on head injury recovery. J Head Trauma Rehabil. 1989: 47582.
Sparadeo FR, Strauss D, Barth JT. The incidence, impact, and treatment of substance abuse in head trauma rehabilitation. J Head Trauma Rehabil. 1990; 5(3): 18.
Spatt J, Zebenholzer K, Oder W. Psychosocial long-term outcome of severe head injury as perceived by patients, relatives, and professionals. Acta Neurol Scand. 1997; 95: 1739. [PubMed]
Spettell CM, Ellis DW, Ross SE, et al. Time of rehabilitation admission and severity of trauma: Effect on brain injury outcome. Arch Phys Med Rehabil. 1991; 72(5): 3205. [PubMed]
Spivack G, Spettell CM, Ellis DW, et al. Effects of intensity of treatment and length of stay on rehabilitation outcomes. Brain Inj. 1992; 6(5): 41934. [PubMed]
Stambrook MM, Peters LC, Deviaene C, et al. Effects of mild, moderate and severe closed head injury on long-term vocational status. Brain Inj. 1990; 4(2): 18390. [PubMed]
Stonnington HH, Burns CT, Sale PR. Return to work for persons with traumatic brain injury: A supported employment approach. Arch Phys Med Rehabil. 1990; 71(13): 104752. [PubMed]
Swaine BR, Sullivan SJ. Longitudinal profile of early motor recovery following severe traumatic brain injury. Brain Inj. 1996; 10(5): 34766. [PubMed]
Tate RL, Lulham JM, Broe GA, et al. Psychosocial outcome for the survivors of severe blunt head injury: The results from a consecutive series of 100 patients. J Neurol Neurosurg Psychiatry. 1989; 52(10): 112834. [PubMed]
Teasdale G, Jennett B. Assessment of coma and impaired consciousness: A practical scale. Lancet. 1974: 2814.
Tennant A, Macdermott N, Neary D. The long-term outcome of head injury: Implications for service planning. Brain Inj. 1995; 9(6): 595605. [PubMed]
Thatcher RW, Cantor DS, McAlister R, et al. Comprehensive predictions of outcome in closed head-injured patients. The development of prognostic equations. Ann NY Acad Sci. 1991; 620: 82101. [PubMed]
Thomas-Stonell N, Johnson P, Schuller R et al. Evaluation of a computer-based program for remediation of cognitive-communication skills. J Head Trauma Rehabil. 1994; 9(4): 2537.
Thomsen IV. Verbal learning in aphasic and non-aphasic patients with severe head injuries. Scand J Rehabil Med. 1977; 9(2): 737. [PubMed]
Thomsen IV. Late psychosocial outcome in severe traumatic brain injury: Preliminary results of a third follow-up study after 20 years. Scand J Rehabil Med Suppl. 1992; 26: 14252. [PubMed]
Torkelson RM, Jellinek HM, Malec JF et al. Traumatic brain injury: Psychological and medical factors related to rehabilitation outcome. Rehabil Psychology. 1983; 28(3): 16976.
Treadwell K, Page T. Functional analysis: Identifying the environmental determinants of severe behavior disorders. J Head Trauma Rehabil. 1996; 11(1): 6274.
Tuel SM, Presty SK, Meythaler JM, et al. Functional improvement in severe head injury after readmission for rehabilitation. Brain Inj. 1992; 6(4): 36372. [PubMed]
Twum M, Parente R. Role of imagery and verbal labeling in the performance of paired associates tasks by persons with closed head injury. J Clin Exp Neuropsychol. 1994; 16(4): 6309. [PubMed]
van Balen HG, Mulder T, Keyser A. Towards a disability-oriented epidemiology of traumatic brain injury. Disability Rehabil. 1996; 18(4): 18190. [PubMed]
Vilkki J, Ahola K, Holst P, Ohman J, et al. Prediction of psychosocial recovery after head injury with cognitive tests and neurobehavioral ratings. J Clin Exp Neuropsychol. 1994; 16(3): 32538. [PubMed]
Vollmer DG, Torner JC, Jane JA, et al. Age and outcome following traumatic coma: Why do older patients fare worse? J Neurosurg. 1991; 75(Suppl): S3749.
Waxman K, Sundine MJ, Young RF. Is early prediction of outcome in severe head injury possible? Arch Surg. 1991; 126(10): 123741; discussion 1242. [PubMed]
Weddell R, Oddy M, Jenkins D. Social adjustment after rehabilitation: A two year follow-up of patients with severe head injury. Psychol Med. 1980; 10(2): 25763. [PubMed]
Wehman P, Kreutzer J, Sale P, et al. Cognitive impairment and remediation: Implications for employment following traumatic brain injury. J Head Trauma Rehabil. 1989; 4(3): 6675.
Wehman P, Kreutzer JS, Stonnington HH, et al. Supported employment for persons with traumatic brain injury: A preliminary report. J Head Trauma Rehabil. 1988; 3(4): 8293.
Wehman P, Kreutzer J, West M, et al. Employment outcomes of persons following traumatic brain injury: Pre-injury, post-injury, and supported employment. Brain Inj. 1989; 3(4): 397412. [PubMed]
Wehman P, Kreutzer J, West M, et al. Return to work for persons with traumatic brain injury: A supported employment approach. Arch Phys Med Rehabil. 1990; 71: 104752. [PubMed]
Wehman P, West M, Fry R, et al. Effect of supported employment on the vocational outcomes of persons with traumatic brain injury. Special Issue: Supported employment. J Appl Behavior Analysis. 1989; 22(4): 395405. [PubMed]
Wehman P, Sherron P, Kregel J, et al. Return to work for persons following severe traumatic brain injury. Supported employment outcomes after five years. Am J Phys Med Rehabil. 1993; 72(6): 35563. [PubMed]
Wehman PH, Revell WG, Kregel J, et al. Supported employment: An alternative model for vocational rehabilitation of persons with severe neurologic, psychiatric, or physical disability. Arch Phys Med Rehabil. 1991; 72(2): 1015. [PubMed]
Whitlock JA Jr. Functional outcome of low-level traumatically brain-injured admitted to an acute rehabilitation programme. Brain Inj. 1992; 6(5): 44759. [PubMed]
Whitlock JA Jr, Hamilton BB. Functional outcome after rehabilitation for severe traumatic brain injury. Arch Phys Med Rehabil. 1995; 76(12): 110312. [PubMed]
Wilson B, Evans J, Emslie H, et al. Evaluation of NeuroPage: A new memory aid. J Neurol Neurosurg Psychiatry. 1997; 63: 1135. [PubMed]
Wood RL, Fussey I. Computer based cognitive retraining: a controlled study. Int Disabil Studies. 1987; 9: 14953. [PubMed]
Woolf PD, Hamill RW, Lee LA, et al. The predictive value of catecholamines in assessing outcome in traumatic brain injury. J Neurosurg. 1987; 66(6): 87582. [PubMed]
Woolf SH , Battista RN, Anderson GM, et al. Assessing the clinical effectiveness of preventive maneuvers: Analytic principles and systematic methods in reviewing evidence and developing clinical practice recommendations. A report by the Canadian Task Force on the Periodic Health Examination. J Clin Epidemiol. 1990; 43: 891905. [PubMed]
Wrigley JM, Yoels WC, Webb CR, et al. Social and physical factors in the referral of people with traumatic brain injuries to rehabilitation. Arch Phys Med Rehabil. 1994; 75(2): 14955. [PubMed]
Ylvisaker M, Feeney T. Executive functions after traumatic brain injury: Supported cognition and self-advocacy. Semin Speech Lang. 1996; 17(3): 21732. [PubMed]
Zafonte RD, Hammond FM, Mann NR, et al. Relationship between Glasgow coma scale and functional outcome. Am J Phys Med Rehabil. 1996; 75(5): 3649. [PubMed]
Bibliography
Abrams D, Toms Barker L. Enhancing employment success for individuals with traumatic brain injury. Report to Social Security Administration by Sharp Rehabilitation Center, San Diego, CA; 1991.
Ainsley J, Gliner J. Factors in the employability of the brain injured adult. Cogn Rehabil. 1989: 2833.
Alberico AM, Ward JD, Choi SC, et al. Outcome after severe head injury. Relationship to mass lesions, diffuse injury, and ICP course in pediatric and adult patients. J Neurosurg. 1987; 67(5): 64856. [PubMed]
Andersen J, Sharkey W, Schwartz ML, et al. Injury severity score, head injury, and patient wait days: Contributions to extended trauma patient length of stay. J Trauma. 1992; 33(2): 21920. [PubMed]
Anderson DC, Bundlie S, Rockswold GL. Multimodality evoked potentials in closed head trauma. Arch Neurol. 1984; 41(4): 36974. [PubMed]
Anderson SI, Wilson CL, McDowell IP, et al. Late rehabilitation for closed head injury: a follow-up study of patients 1 year from time of discharge. Brain Inj. 1996; 10: 11524. [PubMed]
Annoni JM, Beer S, Kesselring J. Severe traumatic brain injury: Epidemiology and outcome after 3 years. Disabil Rehabil. 1992; 14(1): 236. [PubMed]
Aronow HU. Rehabiltation effectiveness with severe brain injury: Translating research into policy. J Head Trauma Rehabil. 1987; 2: 2436.
Ashley MJ, Krych DK. Long-term outcome follow-up of postacute traumatic brain injury rehabilitation: An assessment of functional and behavioral measures of daily living. J Rehabil Outcomes Measures. 1997; 1: 407.
Ashley MJ, Krych DK, Lehr R. Cost-benefit analysis for post-acute rehabilitation of the traumatically brain-injured patient. J Ins Med. 1990; 22: 15661.
Ashley MJ, Lehr PR Jr, Krych DK, et al. Post-acute rehabilitation outcome: Relationship to case-management techniques and strategy. J Ins Med. 1994; 26(3): 34854. [PubMed]
Ashley MJ, Persel CS, Krych DK. Changes in reimbursement climate: Relationship among outcome, cost, and payor type in the postacute rehabilitation environment. J Head Trauma Rehabil. 1993; 8(4): 3047.
Asikainen I, Kaste M, Sarna S. Patients with traumatic brain injury referred to a rehabilitation and re-employment programme: social and professional outcome for 508 Finnish patients 5 or more years after injury. Brain Inj. 1996; 10: 88399. [PubMed]
Barth JT, Macciocchi SN, Giordani B, et al. Neuropsychological sequelae of minor head injury. Neurosurgery. 1983; 13: 52933. [PubMed]
Basso A, Capitani E, Vignolo LA. Influence of rehabilitation on language skills in aphasic patients: A controlled study. Arch Neurol. 1979; 36(4): 1906. [PubMed]
Batchelor J, Shores EA, Marosszeky JE, et al. Cognitive rehabilitation of severely closed-head-injured patients using computer-assisted and noncomputerized treatment techniques. J Head Trauma Rehabil. 1988; 3(3): 7885.
Bell KR, Tallman CA. Community re-entry of long-term institutionalized brain-injured persons. Brain Inj. 1995; 9: 31520. [PubMed]
Ben-Yishay Y, Silver S, Plasetsky E, et al. Relationship between employability and vocational outcome after intensive holistic cognitive rehabilitation. J Head Trauma Rehabil. 1987; 2(1): 3548.
Benedict R. The effectiveness of cognitive remediation strategies for victim of traumatic brain injury: A review of the literature. Clin Psychol Rev. 1989; 9: 60562.
Bergman TA, Rockswold GL, Haines SJ, et al. Outcome of severe closed head injury in the Midwest. A review and comparison with other major head trauma studies. Minn Med. 1987; 70(7): 397401. [PubMed]
Bishara SN, Partridge FM, Godfrey HP, et al. Post-traumatic amnesia and Glasgow Coma Scale related to outcome in survivors in a consecutive series of patients with severe closed-head injury. Brain Inj. 1992; 6(4): 37380. [PubMed]
Blackerby WF. Intensity of rehabilitation and length of stay. Brain Inj. 1990; 4: 16773. [PubMed]
Born JD, Albert A, Hans P, et al. Relative prognostic value of best motor response and brain stem reflexes in patients with severe head injury. Neurosurgery. 1985; 16(5): 595601. [PubMed]
Bond MR. The stages of recovery from severe head injury with special reference to late outcome. Int Rehabil Med. 1979; 1(4): 1559. [PubMed]
Bowers SA, Marshall LF. Outcome in 200 consecutive cases of severe head injury treated in San Diego County: A prospective analysis. Neurosurgery. 1980; 6(3): 23742. [PubMed]
Braakman R, Gelpke GJ, Habbema JD, et al. Systematic selection of prognostic features in patients with severe head injury. Neurosurgery. 1980; 6(4): 36270. [PubMed]
Brooks N, Campsie L, Symington C, et al. The five-year outcome of severe blunt head injury: A relative's view. J Neurol Neurosurg Psychiatry. 1986; 49: 76470. [PubMed]
Brooks N, McKinlay W, Symington C, et al. Return to work within the first seven years of severe head injury. Brain Inj. 1987; 1(1): 519. [PubMed]
Brooks N, Symington C, Beattie A, et al. The effects of severe head injury on patient and relative within seven years of injury. J Head Trauma Rehabil. 1987; 2: 113.
Bullock R, Chesnut R, Clifton G, et al. Guidelines for the management of severe head injury. Revision 1. New York: Brain Trauma Foundation; 1998.
Burke DC. Planning a system of care for head injuries. Brain Inj. 1987; 1: 18998. [PubMed]
Burke WH, Wesolowski MD, Guth ML. Comprehensive head injury rehabilitation: an outcome evaluation. Brain Inj. 1988; 2: 31322. [PubMed]
Burr M. The rehabilitation and long-term management of the adult patient with head injury. Aust Fam Physician. 1981; 10: 146. [PubMed]
Carey RG, Seibert JH, Posavac EJ. Who makes the most progress in inpatient rehabilitation? An analysis of functional gain. Arch Phys Med Rehabil. 1988; 69(5): 33743. [PubMed]
Carlton TO, Stephenson MD. Social work and the management of severe head injury. [Review] [53 refs]. Soc Sci Med. 1990; 31: 511. [PubMed]
Carnevale GJ. Natural-setting behavior management for individuals with traumatic brain injury: Results of a three-year caregiver training program. J Head Trauma Rehabil. 1996; 11(1): 2738.
Cavallo MM, Kay T, Ezrachi O. Problems and changes after traumatic brain injury: Differing perceptions within and between families. Brain Inj. 1992; 6(4): 32735. [PubMed]
Centers for Disease Control and Prevention. Unpublished data from the National Center for Injury Prevention and Control. Personal communication from David Thurman. May 1998.
Chan L, Koepsell TD, Deyo RA, et al. The effect of Medicare's payment system for rehabilitation hospitals on length of stay, charges, and total payments. N Engl J Med. 1997; 337: 97885. [PubMed]
Chandler SK. Predictors of vocational indecision and vocational outcome for adults with traumatic brain injuries. Dissertation Abstracts International. 1901; 54
Chelimsky ES, Shadish W, editors. Evaluation for the 21st century: A handbook. Thousand Oaks, CA: Sage Publications; 1997.
Chen SH, Thomas JD, Glueckauf RL, et al. The effectiveness of computer-assisted cognitive rehabilitation for persons with traumatic brain injury. Brain Inj. 1997; 11: 197209. [PubMed]
Chesnut RM, Alexander D, Antoinette T, et al. Toward an integrated approach to quantitative research on the rehabilitation of patients with TBI: A call for consensus formation of a universal, uniform data set. Forthcoming.
Chesnut RM, Marshall LF, Klauber MR, et al. The role of secondary brain injury in determining outcome from severe head injury. J Trauma. 1993; 34(2): 21622. [PubMed]
Chesnut RM, Marshall SB, Piek J, et al. Early and late systemic hypotension as a frequent and fundamental source of cerebral ischemia following severe brain injury in the Traumatic Coma Data Bank. Acta Neurochir Suppl. 1993; 59: 1215. [PubMed]
Choi SC, Narayan RK, Anderson RL, et al. Enhanced specificity of prognosis in severe head injury. J Neurosurg. 1988; 69(3): 3815. [PubMed]
Cicerone K, Giacino J. Remediation of executive function deficits after traumatic brain injury. Neuropsychol Rehabil. 1992; 2: 1222.
Cicerone KD, Smith LC, Ellmo W, et al. Neuropsychological rehabilitation of mild traumatic brain injury. Brain Inj. 1996; 10: 27786. [PubMed]
Cifu DX, Keyser-Marcus L, Lopez E, et al. Acute predictors of successful return to work 1 year after traumatic brain injury: A multicenter analysis. Arch Phys Med Rehabil. 1997; 78(2): 12531. [PubMed]
Cifu DX, Kreutzer JS, Marwitz JH, et al. Functional outcomes of older adults with traumatic brain injury: A prospective, multicenter analysis. Arch Phys Med Rehabil. 1996; 77(9): 8838. [PubMed]
Coelho CA, DeRuyter F, Stein M. Treatment efficacy: Cognitive-communicative disorders resulting from traumatic brain injury in adults. J Speech Hear Res. 1996; 39(5): S517. [PubMed]
Cole JR, Cope DN, Cervelli L. Rehabilitation of the severely brain-injured patient: a community-based, low-cost model program. Arch Phys Med Rehabil. 1985; 66: 3840. [PubMed]
Commission for Case Management Certification. CCM certification guide. Certified case manager. Rolling Meadows, IL; 1996.
Cope DN. The effectiveness of traumatic brain injury rehabilitation: A review. Brain Inj. 1995; 9: 64970. [PubMed]
Cope DN, Cole JR, Hall KM, et al. Brain injury: analysis of outcome in a post-acute rehabilitation system. Part 2: Subanalyses [see comments]. Brain Inj. 1991; 5(2): 12739. [PubMed]
Cope DN, Hall K. Head injury rehabilitation: benefit of early intervention. Arch Phys Med Rehabil. 1982; 63: 4337. [PubMed]
Corrigan JD, Bogner JA, Mysiw WJ, et al. Systematic bias in outcome studies of persons with traumatic brain injury. Arch Phys Med Rehabil. 1997; 78(2): 1327. [PubMed]
Courtney C. A model for community support and case coordination networks for persons with traumatic brain injury. Final report submitted to Rehabilitation Services Administration, CSDA #84.235, Award H128A91121. St Paul: State of Minnesota Department of Jobs and Training, Division of Rehabilitation Services and Minnesota Head Injury Association; 1992.
Cowen TD, Meythaler JM, DeVivo MJ, et al. Influence of early variables in traumatic brain injury on functional independence measure scores and rehabilitation length of stay and charges [see comments]. Arch Phys Med Rehabil. 1995; 76: 797803. [PubMed]
Crepeau F, Scherzer P. Predictors and indicators of work status after traumatic brain injury: A meta-analysis. Neuropsychol Rehabil. 1993; 3(1): 535.
Curl RM, Chisholm LA. Unlocking coworker potential in competitive employment: Keys to a cooperative approach. J Vocat Rehabil. 1993; 3: 7284.
Curl RM, Fraser RT, Cook RG, et al. Traumatic brain injury vocational rehabilitation: preliminary findings for the coworker as trainer project. J Head Trauma Rehabil. 1996; 11(1): 7585.
Davis CH, Fardanesh L, Rubner D, et al. Profiles of functional recovery in fifty traumatically brain-injured patients after acute rehabilitation. Am J Phys Med Rehabil. 1997; 76: 2138. [PubMed]
David R, Enderby P, Bainton D. Treatment of acquired aphasia: Speech therapists and volunteers compared. J Neurol Neurosurg Psychiatry. 1982; 45(11): 95761. [PubMed]
Dawson DR, Chipman M. The disablement experienced by traumatically brain-injured adults living in the community. Brain Inj. 1995; 9(4): 33953. [PubMed]
Deacon D, Campbell K. Decision making following closed head injury: Can response speed be trained? J Clin Exp Neuropsychol. 1991; 13: 63951. [PubMed]
Deshpande AA, Millis SR, Zafonte RD, et al. Risk factors for acute care transfer among traumatic brain injury patients. Arch Phys Med Rehabil. 1997; 78: 3502. [PubMed]
Devany CW, Kreutzer JS, Halberstadt LJ, et al. Referrals for supported employment after brain injury: Neuropsychological, behavioral, and emotional characteristics. J Head Trauma Rehabil. 1991; 6(3): 5970.
Dikengil A, Lowry M, Delgado P. An interdisciplinary group treatment for the severely brain-injured patient: participation by four disciplines. J Cogn Rehabil. 1993; 11: 204.
Dikmen S, Machamer J, Temkin N. Psychosocial outcome in patients with moderate to severe head injury: 2-year follow-up. Brain Inj. 1993; 7(2): 11324. [PubMed]
Dikmen S, Reitan RM, Temkin NR. Neuropsychological recovery in head injury. Arch Neurol. 1983; 40(6): 3338. [PubMed]
Dikmen SS, Temkin NR, Machamer JE, et al. Employment following traumatic head injuries. Arch Neurol. 1994; 51: 17786. [PubMed]
Dombovy ML, Olek AC. Recovery and rehabilitation following traumatic brain injury. Brain Inj. 1997; 11(5): 30518. [PubMed]
Eames P, Cotterill G, Kneale TA, et al. Outcome of intensive rehabilitation after severe brain injury: A long-term follow-up study. Brain Inj. 1996; 10: 63150. [PubMed]
Eames P, Wood R. Rehabilitation after severe brain injury: A follow-up study of a behavior modification approach. J Neurol Neurosurg Psychiatry. 1985; 48(7): 61319. [PubMed]
Edna TH, Cappelen J. Return to work and social adjustment after traumatic head injury. Acta Neurochir. 1987; 85(1-2): 403. [PubMed]
Ehrlich J, Sipes A. Group treatment of communication skills for head trauma patients. Cogn Rehabil. 1985; 3: 3237.
Eliason MR, Topp BW. Predictive validity of Rappaport's Disability Rating Scale in subjects with acute brain dysfunction. Phys Ther. 1984; 64(9): 135760. [PubMed]
Ellerd DA, Moore SC. Follow-up at twelve and thirty months of persons with traumatic brain injury engaged in supported employment placements. J Appl Rehabil Couns. 1992; 23(3): 4850.
Engberg A. Severe traumatic brain injury-- epidemiology, external causes, prevention, and rehabilitation of mental and physical sequelae. Acta Neurol Scand Suppl. 1995; 164: 1151. [PubMed]
Evans R, Ruff RM. Outcome and value: A perspective on rehabilitation outcomes achieved in acquired brain injury. J Head Trauma Rehabil. 1992; 7(4): 2436.
Evans RW, Watke M. Catastrophic neurologic injury: Improving outcomes through case management. Case Manager. 1995; 6(3): 835, 87-8.
Ewing CL, Thomas DJ, Sansces A, et al. Impact of injury of the head and spine. Springfield, IL: Thomas; 1983.
Ezrachi O, Ben-Yishay Y, Kay T, et al. Predicting employment in traumatic brain injury following neuropsychological rehabilitation. J Head Trauma Rehabil. 1991; 6: 7184.
Fabiano RJ, Crewe N. Variables associated with employment following severe traumatic brain injury. Rehabil Psychol. 1995; 40: 22331.
Fairweather G, Sanders DL, Maynard H et al. Community life for the mentally ill: An experiment in social innovation. Chicago: Aldine; 1969.
Fearnside MR, Cook RJ, McDougall P, et al. The Westmead Head Injury Project. Physical and social outcomes following severe head injury. Br J Neurosurg. 1993; 7(6): 64350. [PubMed]
Fiedler RC, Granger CV. Uniform data system for medical rehabilitation: report of first admissions for 1995. Am J Phys Med Rehabil. 1997; 76(1): 7681. [PubMed]
Finset A, Dyrnes S, Krogstad JM, et al. Self-reported social networks and interpersonal support 2 years after severe traumatic brain injury. Brain Inj. 1995; 9: 14150. [PubMed]
Fraser R, Dikmen S, McLean A, et al. Employability of head injury survivors: First year post-injury. Special issue: Traumatic brain injury. Rehabil Counsel Bull. 1988; 31(4): 276288.
Freeman MR, Mittenberg W, Dicowden M, Bat-Ami M. Executive and compensatory memory retraining in traumatic brain injury. Brain Inj. 1992; 6: 6570. [PubMed]
Fryer LJ, Haffer WJ. Cognitive rehabilitation and community readaption: Outcomes from two program models. J Head Trauma Rehabil. 1987; 2: 5163.
Fussey K, Tyerman A. An exploration of memory retraining in rehabilitation following closed head-injury. Int J Rehabil Res. 1985; 8: 4657.
Gerber L. Case management models: Geriatric nursing prototypes for growth. J Gerontol Nurs. 1994; 20(7): 1824. [PubMed]
Giacino JT, Kezmarsky MA, DeLuca J, et al. Monitoring rate of recovery to predict outcome in minimally responsive patients. Arch Phys Med Rehabil. 1991; 72(11): 897901. [PubMed]
Girard D, Brown J, Burnett-Stolnack M, et al. The relationship of neuropsychological status and productive outcomes following traumatic brain injury. Brain Inj. 1996; 10: 66376. [PubMed]
Gleckman AD, Brill S. The impact of brain injury on family functioning: implications for subacute rehabilitation programmes. Brain Inj. 1995; 9: 38593. [PubMed]
Glisky EL, Delaney SM. Implicit memory and new semantic learning in posttraumatic amnesia. J Head Trauma Rehabil. 1996; 1: 3142.
Glisky EL, Schacter DL. Long-term retention of computer learning by patients with memory disorders. Neuropsychologia. 1988; 26: 1738. [PubMed]
Glisky EL, Schacter DL, Tulving E. Learning and retention of computer-related vocabulary in memory-impaired patients: Method of vanishing cues. J Clin Exp Neuropsychol. 1986a; 8: 292312. [PubMed]
Glisky EL, Schacter Dl, Tulving E. Computer learning by memory-impaired patients: Acquisition and retention of complex knowledge. Neuropsychologia. 1986b; 24: 31328. [PubMed]
Gloag D. Rehabilitation after head injury: 2--Behaviour and emotional problems, long term needs, and the requirements for services. Br Med J Clin Res Ed. 1985; 290: 9136. [PubMed]
Gobiet W. Improved clinical outcome with early rehabilitation. Neurosurg Rev. 1989; 12 Suppl 1: 1436. [PubMed]
Godfrey H, Knight R, Bishara S. The relationship between social skill and family problem-solving following very severe closed head injury. Brain Inj. 1991; 5(2): 20711. [PubMed]
Goering PN, Wasylenki DA, Farkas M, et al. What difference does case management make? Hosp Comm Psychiatry. 1988; 39: 2726. [PubMed]
Goka R, Arakaki A. Brain injury rehabilitation; the continuum of care. Brain Inj Rehabil. 1994; 26: 4205. [PubMed]
Goldstein G, Beers S, Longmore S, et al. Efficacy of memory training: A technological extention and replication. Clin Neuropsychologist. 1996; 10: 6672.
Goldstein G, McCue M, Turner S, et al. An efficacy study of memory training for patients with closed-head injury. Clin Neuropsychologist. 1988; 2: 2519.
Goldstein G, Ruthven L. Rehabilitation of the brain-damaged adult. Chapter 6, The Wichita Program. New York: Plenum Press; 1983.
Goldstein K. The organism: A holistic approach to biology derived from pathological data in man. New York: Urzone; 1995.
Goodwin D. Nursing case management activities: How they differ between employment settings. J Nurs Adm. 1994; 24(2): 2934. [PubMed]
Gopinath SP, Robertson CS, Contant CF, et al. Jugular venous desaturation and outcome after head injury. J Neurol Neurosurg Psychiatry. 1994; 57(6): 71723. [PubMed]
Gouvier WD, Blanton PD, LaPorte KK, et al. Reliability and validity of the Disability Rating Scale and the Levels of Cognitive Functioning Scale in monitoring recovery from severe head injury. Arch Phys Med Rehabil. 1987; 68(2): 947. [PubMed]
Granger CV, Hamilton BB, Sherwin FS. Guide for use of the uniform data set for medical rehabilitation. Buffalo, NY: Uniform Data System for Medical Rehabilitation; 1986.
Gray JM, Robertson I, Pentland B, et al. Microcomputer-based attentional retraining after brain damage: A randomised group controlled trial. Neuropsychol Rehabil. 1992; 2: 97115.
Gray JM, Shepherd M, McKinlay WW, et al. Negative symptoms in the traumatically brain-injured during the first year postdischarge, and their effect on rehabilitation status, work status and family burden. Clin Rehabil. 1994; 8: 18897.
Greenspan AI, Wrigley JM, Kresnow M, et al. Factors influencing failure to return to work due to traumatic brain injury. Brain Inj. 1996; 10(3): 20718. [PubMed]
Greenwood RJ, McMillan TM, Brooks DN, et al. Effects of case management after severe head injury [see comments]. BMJ. 1994; 308: 1199205. [PubMed]
Groah SL, Cifu DX. The rehabilitative management of the traumatic brain injury patient with associated femoral neuropathy. Arch Phys Med Rehabil. 1995; 76: 4803. [PubMed]
Gronwall D. Paced auditory serial-addition task: A measure of recovery from concussion. Percept Mot Skills. 1977; 44: 36773. [PubMed]
Gronwall D. Rehabilitation programs for patients with mild head injury: Components, problems, and evaluation. J Head Trauma Rehabil. 1986; 1(2): 5362.
Gronwall D, Wrightson P. Duration of post-traumatic amnesia after mild head injury. J Clin Neuropsychol. 1980; 2(1): 5160.
Groswasser Z, Mendelson L, Strern MJ, et al. Re-evaluation of prognostic factors in rehabilitation after severe head injury. Assessment thirty months after trauma. Scand J Rehabil Med. 1977; 9: 1479. [PubMed]
Haffey WJ, Abrams DL. Employment outcomes for participants in a brain injury work reentry program: Preliminary findings. J Head Trauma Rehabil. 1991; 6: 2434.
Hagen C, Malkmus D, Durham P, et al. Levels of cognitive functioning. Rehabilitation of the head injured adult. Comprehensive physical management. Downey, CA: Professional Staff Association, Rancho Los Amigos Hospital; 1979.
Hall K, Cope D. The benefit of rehabilitation in traumatic brain injury. A literature review. J Head Trauma Rehabil. 1995; 10(1): 11.
Hall K, Cope DN, Rappaport M. Glasgow Outcome Scale and Disability Rating Scale: Comparative usefulness in following recovery in traumatic head injury. Arch Phys Med Rehabil. 1985; 66(1): 357. [PubMed]
Hall KM, Mann N, High WM Jr, et al. Functional measures after traumatic brain injury: ceiling effects of FIM, FIM+FAM, DRS, and CIQ. J Head Trauma Rehabil. 1996; 11(5): 2739.
Hall M, Brandys C, Yetman L. Multidisciplinary approaches to management of acute head injury. J Neurosci Nurs. 1992; 24: 199204. [PubMed]
Harrick L, Krefting L, Johnston J, et al. Stability of functional outcomes following transitional living programme participation: 3-year follow-up. Brain Inj. 1994; 8: 43947. [PubMed]
Hawkins ML, Lewis FD, Medeiros RS. Serious traumatic brain injury: An evaluation of functional outcomes. J Trauma. 1996; 41: 25763; discussion 263-4. [PubMed]
Heilbronner RL, Roueche JR, Everson SA, et al. Comparing patient perspectives of disability and treatment effects with quality of participation in a post-acute brain injury rehabilitation programme. Brain Inj. 1989; 3: 38795. [PubMed]
Heinemann AW, Hamilton B, Linacre JM, et al. Functional status and therapeutic intensity during inpatient rehabilitation. Am J Phys Med Rehabil. 1995; 74(4): 31526. [PubMed]
Heinemann AW, Sahgal V, Cichowski K, et al. Functional outcome following traumatic brain injury. J Neuro Rehabil. 1990; 4: 2737.
Helffenstein D, Wechsier R. The use of interpersonal process recall (PR) in the remediation of interpersonal and communication skill deficits in the newly brain injured. Clin Neuropsychol. 1982; 4: 13943.
Hendryx P. Psychosocial changes perceived by closed-head-injured adults and their families. Arch Phys Med Rehabil. 1989; (70): 52630. [PubMed]
High WM Jr, Boake C, Lehmkuhl L. Critical analysis of studies evaluating the effectiveness of rehabilitation after traumatic head injury. J Head Trauma Rehabil. 1995; 10(1): 1426.
High WM Jr, Hall KM, Rosenthal M, et al. Factors affecting hospital length of stay and charges following traumatic brain injury of injured adults living in the community. Brain Inj. 1996; 9(4): 33953.
High WM Jr, Hall KM, Rosenthal M, et al. Factors affecting hospital length of stay and charges following traumatic brain injury. J Head Trauma Rehabil. 1996; 11: 8596.
Hunter WH. Gunshot wound of the head: a fortunate outcome. J S C Med Assoc. 1981; 77: 4478. [PubMed]
Ip RY, Dornan J, Schentag C. Traumatic brain injury: factors predicting return to work or school. Brain Inj. 1995; 9: 51732. [PubMed]
Jacobs HE. The Los Angeles Head Injury Survey: Procedures and initial findings. Arch Phys Med Rehabil. 1988; 69(6): 42531. [PubMed]
Jacobs HE, Hart T, Mory KD, et al. Single-subject evaluation designs in rehabilitation: case studies on inpatient units. J Head Trauma Rehabil. 1996; 11: 8694.
Jaffe KM, Massagli TL, Martin KM, et al. Pediatric traumatic brain injury: Acute and rehabilitation costs. Arch Phys Med Rehabil. 1993; 74: 6816. [PubMed]
Jennett B, Bond M. Assessment of outcome after severe brain damage: A practical scale. Lancet. 1975: 14804.
Jennett B, Snoek J, Bond MR, et al. Disability after severe head injury: Observations of the use of the Glasgow Outcome Scale. J Neurol Neurosurg Psychiatry. 1981; 44(4): 28593. [PubMed]
Jennett B, Teasdale G, Galbraith S, et al. Prognosis in patients with severe head injury. Acta Neurochir Suppl. 1979; 28(1): 14952. [PubMed]
Johnson D, Roethig-Johnston K. Head injury. Early rehabilitation of head-injured patients. Nurs Times. 1989; 85: 258. [PubMed]
Johnson R. Return to work after sever head injury. Int Disabil Studies. 1987; 9: 4954. [PubMed]
Johnson R. Employment after severe head injury: do the Manpower Services Commission schemes help? Injury. 1989; 20: 59. [PubMed]
Johnston MV. Outcomes of community re-entry programmes for brain injury survivors. Part 2: Further investigations [see comments]. Brain Inj. 1991; 5: 15568. [PubMed]
Johnston MV, Hall KM. Outcomes evaluation in TBI rehabilitation. Part I: Overview and system principles. Arch Phys Med Rehabil. 1994; 75: SC2SC28.
Johnston MV, Lewis FD. Outcomes of community re-entry programmes for brain injury survivors. Part 1: Independent living and productive activities. Brain Injury. 1991; 5(2): 14154. [PubMed]
Jones C. Outcome following closed head injury. J Neurosurg Nurs. 1981; 13(4): 17883. [PubMed]
Jones ML, Evans RW. Outcome validation in post-acute rehabilitation: Trends and correlates in treatment and outcome. J Ins Med. 1992; 24(3): 18692. [PubMed]
Jones PA, Andrews PJ, Midgley S, et al. Measuring the burden of secondary insults in head-injured patients during intensive care. J Neurosurg Anesth. 1994; 6(1): 414. [PubMed]
Jorgensen HS. Hospital rehabilitation of patients with severe brain injuries. II. Prognosis and effect of early intensive, specialized rehabilitation. Ugeskr Laeger. 1997; 159(26): 40939. [PubMed]
Kaitaro T, Koskinen S, Kaipio ML. Neurophysiological problems in everyday life: A 5-year follow-up study of young severely closed-head-injured patients. Brain Inj. 1995; 9(7): 71327. [PubMed]
Kerner M, Acker M. Computer delivery of memory retraining with head injured patients. Cogn Rehabil. 1985; Nov/Dec: 2631.
King NS, Crawford S, Wenden FJ, et al. Interventions and service need following mild and moderate head injury: the Oxford Head Injury Service. Clin Rehabil. 1997; 11: 1327. [PubMed]
Klauber MR, Marshall LF, Luerssen TG, et al. Determinants of head injury mortality: Importance of the low risk patient. Neurosurgery. 1989; 24(1): 316. [PubMed]
Klonoff H, Clark C, Klonoff PS. Long-term outcome of head injuries: A 23 year follow up study of children with head injuries. J Neurol Neurosurg Psychiatry. 1993; 56: 4105. [PubMed]
Kock C, Fuhrmann R. [Early neurologic rehabilitation--an urgent requirement] [German]. Rehabilitation. 1992; 31(4): 2179. [PubMed]
Kosubek C, Feldmann M, Schwendemann G. Early neurological rehabilitation. Local demand for early rehabilitation places for adult patients illustrated for the Land Bremen [Early neurologic-neurosurgical rehabilitation--on the epidemiology of the need for early rehabilitation beds by adult patients exemplified by the Bremen federal district][German]. Rehabilitation (Stuttgart). 1996; 35(1): 2932. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
Kozloff R. Networks of social support and the outcome from severe head injury. J Head Trauma Rehabil. 1987; 2(3): 1423.
Kraft JF, Schwab KA, Salazar AM, et al. Occupational and educational achievements of head injured Vietnam veterans at 15-year follow-up. Arch Phys Med Rehabil. 1993; 74(6): 596601. [PubMed]
Kraus J, Sorenson S. Epidemiology. In Silver JM, Yudofsky SC, Hales RE (eds), Neuropsychiatry of traumatic brain injury. Washington, DC: American Psychiatric Press; 1994.
Kraus JF, McArthur DL. Epidemiologic aspects of brain injury. Neurologic Clinics. 1996; 14(2): 43550. [PubMed]
Kreutzer J, Wehman P, Morton MV, et al. Supported employment and compensatory strategies for enhancing vocational outcome following traumatic brain injury. Brain Inj. 1988; 2: 20523. [PubMed]
Kreutzer JS, Conder R, Wehman P, et al. Compensatory strategies for enhancing independent living and vocational outcome following traumatic brain injury. Cogn Rehabil. 1989; 7: 305.
Kreutzer JS, Doherty R, Harris JA. Alcohol abuse among persons with traumatic brain injury. J Head Trauma Rehabil. 1990; 5: 920.
Kreutzer JS, Marwitz JH, Kepler K. Traumatic brain injury: family response and outcome. Arch Phys Med Rehabil. 1992; 73(3): 7718. [PubMed]
Kwasnica CM, Heinemann A. Coping with traumatic brain injury: Representative case studies. Arch Phys Med Rehabil. 1994; 75(4): 3849. [PubMed]
Leathem J, Heath E, Woolley C. Relatives' perceptions of role change, social support and stress after traumatic brain injury. Brain Inj. 1996; 10(1): 2738. [PubMed]
Lehmkulh LD, Hall KM, Mann N, et al. Factors that influence costs and length of stay in persons with traumatic brain injury in acute care and inpatient rehabilitation. J Head Trauma Rehabil. 1993; 8(2): 88100.
Levin HS, Benton AL, Grossman RG. Neurobehavioral consequences of closed head injury. New York: Oxford University Press; 1982.
Levin HS, Gary HE Jr, Eisenberg HM, et al. Neurobehavioral outcome 1 year after severe head injury. Experience of the Traumatic Coma Data Bank. J Neurosurg. 1990; 73(5): 699709. [PubMed]
Levin HS, O'Donnell VM, Grossman RG. The Galveston Orientation and Amnesia Test. A practical scale to assess cognition after head injury. J Nerv Ment Dis. 1979; 167(11): 67584. [PubMed]
Lewin ICF. The cost of disorders of the brain. Washington, DC: National Foundation for the Brain; 1992.
Lezak MD. Assessment for rehabilitation planning. In Meier MJ, Benton AL, Diller L, eds. Neuropsycholog-ical rehabilitation. New York: Guilford Press; 1987.
Lezak MD. Neuropsychological assessment. New York: Oxford University Press; 1995.
Li L, Lu SF, Jiang XH. Clinical analysis of 80 cases of post-traumatic chronic subdural hematoma. Acta Acad Med Wuhan. 1984; 4: 2526. [PubMed]
Livingston MG, Brooks DN, Bond MR. Patient outcome in the year following severe head injury and relatives' psychiatric and social functioning. J Neurol Neurosurg Psychiatry. 1985; 48: 87681. [PubMed]
Lloyd LF, Cuvo AJ. Maintenance and generalization of behaviours after treatment of persons with traumatic brain injury. Brain Inj. 1994; 8: 52940. [PubMed]
Lomas J, Kertesz A. Patterns of spontaneous recovery in aphasic groups: A study of adult stroke patients. Brain Lang. 1978; 5(3): 388401. [PubMed]
Lyle DM, Pierce JP, Freeman EA, et al. Clinical course and outcome of severe head injury in Australia. J Neurosurg. 1986; 65: 158. [PubMed]
Mackay LE, Bernstein BA, Chapman PE, et al. Early intervention in severe head injury: long-term benefits of a formalized program. Arch Phys Med Rehabil. 1992; 73(7): 63541. [PubMed]
Malec JF, Basford JS. Postacute brain injury rehabilitation. Arch Phys Med Rehabil. 1996; 77: 198207. [PubMed]
Malec JF, Buffington AL, Moessner AM, et al. Maximizing vocational outcome after brain injury: integration of medical and vocational hospital-based services. Mayo Clinic Proc. 1995; 70(12): 116571. [PubMed]
Malec JF, Questad K. Rehabilitation of memory after craniocerebral trauma. Arch Phys Med Rehabil. 1983; 64: 4368. [PubMed]
Malec JF, Smigielski JS, DePompolo RW, et al. Outcome evaluation and prediction in a comprehensive-integrated post-acute outpatient brain injury rehabilitation programme. Brain Inj. 1993; 7(1): 1529. [PubMed]
Malia K, Powell G, Torode S. Coping and psychosocial function after brain injury. Brain Inj. 1995a; 9: 60717. [PubMed]
Malia K, Powell G, Torode S. Personality and psychosocial function after brain injury. Brain Inj. 1995b; 9: 697712. [PubMed]
Mantyla M. Post-traumatic cerebral atrophy. A study on brain-injured veterans on the Finnish wars of 1939-40 and 1941-45. Ann Clin Res. 1981; 13: 147. [PubMed]
Marion DW, editor. Traumatic brain injury. New York: Thieme; 1999; pp. 121-2.
Marion DW, Carlier PM. Problems with initial Glasgow Coma Scale assessment caused by prehospital treatment of patients with head injuries: Results of a national survey. J Trauma. 1994; 36(1): 8995. [PubMed]
Marks C, Parente F, Anderson J. Retention of gains in outpatient cognitive rehabilitation therapy. Cogn Rehabil. 1986; 4: 203.
Marmarou A, Anderson RL, Ward JD, et al. Impact of ICP instability and hypotension on outcome in patients with severe head trauma. J Neurosurg. 1991; 75(Suppl): S15966.
Marshall LF, Becker DP, Bowers SA, et al. The National Traumatic Coma Data Bank. Part 1: Design, purpose, goals, and results. J Neurosurg. 1983; 59: 27684. [PubMed]
Marshall LF, Bowers-Marshall S, Klauber MR, et al. A new classification of head injury based on computerized tomography. J Neurosurg. 1991; 75(Suppl): S1420.
Marshall LF, Gautille T, Klauber MR, et al. The outcome of severe head injury. J Neurosurg. 1991; 75(Suppl): S2836.
Maslow A. Motivation and personality, 3rd ed. New York: Harper & Row; 1987.
Masson F, Maurette P, Salmi LR, et al. Prevalence of impairments 5 years after a head injury, and their relationship with disabilities and outcome. Brain Inj. 1996; 10: 48797. [PubMed]
Mayer T, Walker ML, Shasha I, et al. Effect of multiple trauma on outcome of pediatric patients with neurologic injuries. Childs Brain. 1981; 8(3): 18997. [PubMed]
McLaughlin AM, Peters S. Evaluation of an innovative cost-effective programme for brain injury patients: response to a need for flexible treatment planning. Brain Inj. 1993; 7(1): 715. [PubMed]
McMillan TM, Greenwood RJ, Morris JR, et al. An introduction to the concept of head injury case management with respect to the need for service provision. Clin Rehabil. 1988; 2: 31922.
McMordie WR, Barker SL. The financial trauma of head injury. Brain Inj. 1988; 2(4): 35764. [PubMed]
Menard MR. Comparison of disability behavior after different sites and types of injury in a workers' compensation population. J Occup Env Medicine. 1996; 38: 116170. [PubMed]
Middleton DK, Lambert MJ, Seggar LB. Neuropsychological rehabilitation: microcomputer-assisted treatment of brain-injured adults. Percept Motor Skills. 1991; 72: 52730. [PubMed]
Mills VM, Nesbeda T, Katz DI, et al. Outcomes for traumatically brain-injured patients following post-acute rehabilitation programmes. Brain Inj. 1992; 6(3): 21928. [PubMed]
Morgan AS, Chapman P, Tokarski L. Improved care of the traumatically brain injured. Presented at Eastern Association for Surgery of Trauma. First Annual Conference; January 15,1988; Longboat Key, FL.
Morton MV, Wehman P. Psychosocial and emotional sequelae of individuals with traumatic brain injury: A literature review and recommendations. Brain Inj. 1995; 9(1): 8192. [PubMed]
Murphy LD, McMillan TM, Greenwood RJ, et al. Services for severely head-injured patients in north London and environs. Brain Inj. 1990; 4: 95100. [PubMed]
Najenson T, Groswasser Z, Mendelson L, et al. Rehabilitation outcome of brain damaged patients after severe head injury. Int Rehabil Med. 1980; 2(1): 1722. [PubMed]
Neistadt ME. Occupational therapy treatments for constructional deficits. Am J Occup Ther. 1992; 46(2): 1418. [PubMed]
Niemann H, Ruff RM, Baser CA. Computer-assisted attention retraining in head-injured individuals: A controlled efficacy study of an outpatient program. J Consult Clin Psychol. 1990; 58(6): 8117. [PubMed]
Novack TA, Caldwell SG, Duke LW, et al. Focused versus unstructured intervention for attention deficits after traumatic brain injury. J Head Trauma Rehabil. 1996; 11(3): 5260.
Oddy M, Humphrey M. Social recovery during the year following severe head injury. J Neurol Neurosurg Psychiatry. 1980; 43(9): 798802. [PubMed]
Olver JH. Brain injury: The need to assess outcome. Curr Opin Neurol. 1995; 8: 4436. [PubMed]
Olver JH, Ponsford JL, Curran CA. Outcome following traumatic brain injury: A comparison between 2 and 5 years after injury. Brain Inj. 1996; 10(11): 8418. [PubMed]
Ommaya AK, Salazar AM, Dannenberg AL, et al. Outcome after traumatic brain injury in the U.S. military medical system. J Trauma. 1996; 41: 9725. [PubMed]
Ostby S, Sakata R, Leung P. Perceived persistence of problems in post-head-injury rehabilitation. Brain Inj. 1991; 5(1): 916. [PubMed]
O'Reilly M, Green G, Braunling-McMorrow D. Self administered written prompts to teach home accident prevention skills to adults with brain injuries. J Appl Behav Anal. 1990; 23: 43146. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
Palmer CD. The brain trauma rehabilitation program Southfield Rehabilitation Center. Cogn Rehabil. 1985; 3: 49.
Panikoff LB. Recovery trends of functional skills in the head-injured adult. Am J Occup Ther. 1983; 37(11): 73543. [PubMed]
Panting AM, Merry PH. Long-term rehabilitation of severe head injuries with particular reference to need for social and medical support for the patient's family. Rehabilitation. 1972: 82337.
Parente R, Parente-Anderson J. Retraining memory: Theory and application. J Head Trauma Rehabil. 1989; 4: 5565.
Partridge TM. An investigation into the vocational rehabilitation practices provided by brain injury services throughout the United Kingdom. Work. 1996; 7: 6372.
Pazzaglia P, Frank G, Frank F, et al. Clinical course and prognosis of acute post-traumatic coma. J Neurol Neurosurg Psychiatry. 1975; 38(2): 14954. [PubMed]
Pentland B, Miller JD. Head injury rehabilitation in Edinburgh. Health Bull. 1986; 44(2): 1059. [PubMed]
Perry WD. Surviving head injury: A social worker's account. Health Soc Work. 1986; 11: 2048. [PubMed]
Peters MD, Gluck M, McCormick M. Behaviour rehabilitation of the challenging client in less restrictive settings. Brain Inj. 1992; 6(4): 299314. [PubMed]
Pettifer S. Leisure as compensation for employment and unfulfilling work: Reality or pipedream. J Occup Sci. 1993; 1(2): 208.
Ponsford JL, Kinsella G. Evaluation of a remedial programme for attentional deficits following closed-head injury. J Clin Exp Neuropsychol. 1988; 10(6): 693708. [PubMed]
Ponsford JL, Olver JH, Curran C. A profile of outcome: 2 years after traumatic brain injury. Brain Inj. 1995; 9(1): 110. [PubMed]
Possl J, Yves Von Cramon D. Clients' view of neuropsychological rehabilitation. Brain Inj. 1996; 10: 12532. [PubMed]
Powell T, Pancsofar EL, Steere KE, et al. Supported employment: Providing integrated employment opportunities for persons with disabilities. New York: Longman; 1991.
Pressley M. Teaching cognitive strategies to brain-injured clients. Semin Speech Language. 1993; 14: 116.
Prevey M, Delaney R, De l'Aune W, et al. A method of assessing the efficacy of memory rehabilitation techniques using a "real-world" memory task: Learning a computer language. J Rehabil Res Dev. 1991; 228: 5360. [PubMed]
Prigatano G. Neuropsychological rehabilitation of the traumatically brain injured. Baltimore: Johns Hopkins University Press; 1986.
Prigatano GP, Fordyce DJ, Zeiner HK, et al. Neuropsychological rehabilitation after closed head injury in young adults. J Neurol Neurosurg Psychiatry. 1984; 47(5): 50513. [PubMed]
Ragnarsson KT, Thomas JP, Zasler ND. Model systems of care for individuals with traumatic brain injury. J Head Trauma Rehabil. 1993; 8(2): 111.
Rao N, Kilgore KM. Predicting return to work in traumatic brain injury using assessment scales. Arch Phys Med Rehabil. 1992; 73(10): 9116. [PubMed]
Rappaport M, Hall KM, Hopkins K, et al. Disability rating scale for severe head trauma: Coma to community. Arch Phys Med Rehabil. 1982; 63(3): 11823. [PubMed]
Rappaport M, Herrero-Backe C, Rappaport ML, et al. Head injury outcome up to ten years later. Arch Phys Med Rehabil. 1989; 70(13): 88592. [PubMed]
Reeder KP, Rosenthal M, Lichtenberg P, et al. Impact of age on functional outcome following traumatic brain injury. J Head Trauma Rehabil. 1996; 11(3): 2231.
Resnick C. The effect of head injury on family and marital stability. Soc Work Health Care. 1993; 18(2): 4962. [PubMed]
Rivara JB, Jaffe KM, Fay GC, et al. Family functioning and injury severity as predictors of child functioning one year following traumatic brain injury. Arch Phys Med Rehabil. 1993; 74: 104755. [PubMed]
Robertson CS, Contant CF, Gokaslan ZL, et al. Cerebral blood flow, arteriovenous oxygen difference, and outcome in head injured patients. J Neurol Neurosurg Psychiatry. 1992; 55(7): 594603. [PubMed]
Roe A. The psychology of occupations. New York: Wiley; 1956.
Roessler R, Schriner K, Price P. Employment concerns of people with head injuries. J Rehabil. 1992; 58: 1722.
Rosenbaum MNT, Najenson T. Changes in life patterns and symptoms of low mood as reported by wives of severely injured soldiers. J Consult Clin Psychol. 1976; 44(6): 8818. [PubMed]
Rosenthal M, Young T. Effective family intervention after traumatic brain injury: Theory and practice. J Head Trauma Rehabil. 1988; 3(4): 4250.
Ross T, Temkin NR, Newell D. Neuropsychological outcome in relation to head injury severity. Am J Phys Med Rehabil. 1994; 73: 3417. [PubMed]
Ruff R, Mahaffey R, Engel J, et al. Efficacy study of THINKable in the attention and memory retraining of traumatically head-injured patients. Brain Inj. 1994; 8: 314. [PubMed]
Ruff RM, Baser CA, Johnston JW, et al. Neuropsychological rehabilitation: An experimental study with head-injured patients. J Head Trauma Rehabil. 1989; 4(3): 2036.
Ruff RM, Niemann H. Cognitive rehabilitation versus day treatment in head-injured adults: Is there an impact on emotional and psychosocial adjustment? Brain Inj. 1990; 4(4): 33947. [PubMed]
Ruff RM, Marshall LF, Crouch J, et al. Predictors of outcome following severe head trauma: Follow-up data from the Traumatic Coma Data Bank. Brain Inj. 1993; 7(2): 10111. [PubMed]
Ruff RM, Marshall LF, Klauber MR, et al. Alcohol abuse and neurological outcome of the severely head injured. J Head Trauma Rehabil. 1990; 5: 2131.
Rusk HA, Block JM, Lowman EW. Rehabilitation following traumatic brain damage: Immediate and long-term follow-up results in 127 cases. Med Clin North Am. 1969; 53(3): 67784. [PubMed]
Russell WR. Cerebral involvement in head injury. Brain. 1932; 55: 549603.
Russell WR. Amnesia following head injuries. Lancet. 1935; 2: 7623.
Russell WR, Smith A. Post-traumatic amnesia in closed head injury. Arch Neurol. 1961; 5: 417. [PubMed]
Russell WR, Nathan PW. Traumatic amnesias. Brain. 1946; 69: 280301.
Ryan T, Ruff R. The efficacy of structured memory retraining in a group comparison of head trauma patients. Arch Clin Neuropsychol. 1988; 3: 16579. [PubMed]
Sahgal V, Heinemann A. Recovery of function during inpatient rehabilitation for moderate traumatic brain injury. Scand J Rehabil Med. 1989; 21: 719. [PubMed]
Sakata R, Ostby S, Leung P. Functional status, referral and cost of treatment for persons with traumatic head injury. Brain Inj. 1991; 5(4): 4119. [PubMed]
Sale P, West M, Sherron P, et al. Exploratory analysis of job separations from supported employment for persons with traumatic brain injury. J Head Trauma Rehabil. 1991; 6(3): 111.
Sample PRA, Rowntree AJ. Employment intervention strategies for individuals with brain injury. Occup Ther Health Care. 1995; 9(1): 4556.
Sander AM, Kreutzer JS, Rosenthal M, et al. A multicenter longitudinal investigation of return to work and community integration following traumatic brain injury. J Head Trauma Rehabil. 1996; 11(5): 7084.
Saneda DL, Corrigan JD. Predicting clearing of post-traumatic amnesia following closed-head injury. Brain Inj. 1992; 6(2): 16774. [PubMed]
Sanguinetti M, Catanzaro M. A comparison of discharge teaching on the consequences of brain injury. J Neurosci Nurs. 1987; 19(5): 2715. [PubMed]
Sarno MT. The status of research in recovery from aphasia. In Y Lebrun & R Hoops (Eds), Recovery in aphasics. Amsterdam: Swets and Zeitlinger; 1976.
Sawin K. The AHCPR effectiveness initiatives: Opportunities for rehabilitation nursing. Rehabil Nurs. 1990; 15: 2646. [PubMed]
Sbordone RJ, Liter JC, Pettler-Jennings P. Recovery of function following severe traumatic brain injury: A retrospective 10-year follow-up. Brain Inj. 1995; 9(3): 28599. [PubMed]
Schalen W, Hansson L, Nordstrom G, et al. Psychosocial outcome 5-8 years after severe traumatic brain lesions and the impact of rehabilitation services. Brain Inj. 1994; 8: 4964. [PubMed]
Schalen WN, Nordstrom G, Nordstrom CH. Economic aspects of capacity for work after severe traumatic brain lesions. Brain Inj. 1994; 8(1): 3747. [PubMed]
Scherzer BP. Rehabilitation following severe head trauma: Results of a three-year program. Arch Phys Med Rehabil. 1986; 67(6): 36674. [PubMed]
Schmitter-Edgecombe M, Fahy JF, Whelan JP, et al. Memory remediation after severe closed head injury: Notebook training versus supportive therapy. J Consult Clin Psychol. 1995; 63(3): 4849. [PubMed]
Schwab K, Grafman J, Salazar AM, et al. Residual impairments and work status 15 years after penetrating head injury: Report from the Vietnam Head Injury Study. Neurology. 1993; 43(1): 95103. [Free Full Text in PMC icon.Free Full text in PMC] [PubMed]
Shepherd G. Psychological disorder and unemployment. Bull Br Psychol Soc. 1981; 34: 3458.
Sherburne E. A rehabilitation protocol for the neuroscience intensive care unit. J Neurosci Nurs. 1986; 18: 1405. [PubMed]
Skord KG, Miranti SV. Towards a more integrated approach to job placement and retention for persons with traumatic brain injury and premorbid disadvantages. Brain Inj. 1994; 8: 38392. [PubMed]
Smigielski JS, Malec JF, Thompson JM, et al. Mayo Medical Center Brain Injury Outpatient Program: Treatment procedures and early outcome data. Mayo Clin Proc. 1992; 67: 76774. [PubMed]
Smith-Knapp K, Corrigan JD, Arnett JA. Predicting functional independence from neuropsychological tests following traumatic brain injury [see comments]. Brain Inj. 1996; 10: 65161. [PubMed]
Sohlberg M, Mateer C. Effectiveness of an attention training program. J Clin Exp Neuropsychol. 1987; 9: 11730. [PubMed]
Sohlberg M, Mateer C. Introduction to cognitive rehabilitation, theory and practice. New York: Guilford Press; 1989.
Sosin DM, Sniezek JE, Waxweiler RJ. Trends in death associated with traumatic brain injury, 1979 through 1992. Success and failure. JAMA. 1995; 273: 177880. [PubMed]
Sparadeo FR, Gill D. Effects of prior alcohol use on head injury recovery. J Head Trauma Rehabil. 1989: 47582.
Sparadeo FR, Strauss D, Barth JT. The incidence, impact, and treatment of substance abuse in head trauma rehabilitation. J Head Trauma Rehabil. 1990; 5(3): 18.
Spatt J, Zebenholzer K, Oder W. Psychosocial long-term outcome of severe head injury as perceived by patients, relatives, and professionals. Acta Neurol Scand. 1997; 95: 1739. [PubMed]
Spettell CM, Ellis DW, Ross SE, et al. Time of rehabilitation admission and severity of trauma: Effect on brain injury outcome. Arch Phys Med Rehabil. 1991; 75(5): 3205. [PubMed]
Spivack G, Spettell CM, Ellis DW, et al. Effects of intensity of treatment and length of stay on rehabilitation outcomes. Brain Inj. 1992; 6(5): 41934. [PubMed]
Stambrook M, Moore AD, Kowalchuk S, et al. Early metabolic and neurologic predictors of long-term quality of life after closed head injury. Can J Surg. 1990; 33: 1158. [PubMed]
Stambrook M, Moore AD, Peters LC, et al. Effects of mild, moderate and severe closed head injury on long-term vocational status. Brain Inj. 1990; 4: 18390. [PubMed]
Stonnington HH, Burns CT, Sale PR. Return to work for persons with traumatic brain injury: A supported employment approach. Arch Phys Med Rehabil. 1990; 71(13): 104752. [PubMed]
Swaine BR, Sullivan SJ. Longitudinal profile of early motor recovery following severe traumatic brain injury. Brain Inj. 1996; 10: 34766. [PubMed]
Talbot LR, Whitaker HA. Brain-injured persons in an altered state of consciousness: Measures and intervention strategies. Brain Inj. 1994; 8: 68999. [PubMed]
Tate RL, Lulham JM, Broe GA, et al. Psychosocial outcome for the survivors of severe blunt head injury: The results from a consecutive series of 100 patients. J Neurol Neurosurg Psychiatry. 1989; 52(10): 112834. [PubMed]
Teasdale G, Jennett B. Assessment of coma and impaired consciousness: A practical scale. Lancet. 1974: 2814.
Tellier A, Adams KM, Walker AE, et al. Long-term effects of severe penetrating head injury on psychosocial adjustment. J Consult Clin Psychol. 1990; 58: 5317. [PubMed]
Tennant A, Macdermott N, Neary D. The long-term outcome of head injury: Implications for service planning. Brain Inj. 1995; 9(6): 595605. [PubMed]
Thatcher RW, Cantor DS, McAlister R, et al. Comprehensive predictions of outcome in closed head-injured patients. The development of prognostic equations. Ann NY Acad Sci. 1991; 620: 82101. [PubMed]
Thienprasit P, Fisher SV, Alcorn MH. Long term outcome of closed head injury. Minn Med. 1985; 68: 55961. [PubMed]
Thomas-Stonell N, Johnson P, Schuller R, et al. Evaluation of a computer-based program for remediation of cognitive-communication skills. J Head Trauma Rehabil. 1994; 9(4): 2537.
Thomsen IV. Late psychosocial outcome in severe traumatic brain injury: Preliminary results of a third follow-up study after 20 years. Scand J Rehabil Med Suppl. 1992; 26: 14252. [PubMed]
Thomsen IV. Verbal learning in aphasic and non-aphasic patients with severe head injuries. Scand J Rehabil Med. 1977; 9(2): 737. [PubMed]
Tobis JS, Puri KB, Sheridan J. Rehabilitation of the severely brain-injured patient. Scand J Rehabil Med. 1982; 14: 838. [PubMed]
Torkelson RM, Jellinek HM, Malec JF, et al. Traumatic brain injury: Psychological and medical factors related to rehabilitation outcome. Rehabil Psychol. 1983; 28(3): 16976.
Treadwell K, Page T. Functional analysis: Identifying the environmental determinants of severe behavior disorders. J Head Trauma Rehabil. 1996; 11(1): 6274.
Tuel SM, Presty SK, Meythaler JM, et al. Functional improvement in severe head injury after readmission for rehabilitation. Brain Inj. 1992; 6(4): 36372. [PubMed]
Twum M, Parente R. Role of imagery and verbal labeling in the performance of paired associates tasks by persons with closed head injury. J Clin Exp Neuropsychol. 1994; 16: 6309. [PubMed]
van Aalst JA, Morris JA Jr, Yates HK, et al. Severely injured geriatric patients return to independent living: A study of factors influencing function and independence. J Trauma. 1991; 31: 1096101; discussion 1101-2. [PubMed]
van Balen HG, Mulder T, Keyser A. Towards a disability-oriented epidemiology of traumatic brain injury. Disabil Rehabil. 1996; 18: 18190. [PubMed]
Vanzomeren V. Residual complaints of patients two years after severe head injury. J Neurol Neurosurg Psychiatry. 1985; 48: 218. [PubMed]
Vilkki J, Ahola K, Holst P, et al. Prediction of psychosocial recovery after head injury with cognitive tests and neurobehavioral ratings. J Clin Exp Neuropsychol. 1994; 16: 32538. [PubMed]
Vogenthaler DR, Smith KR Jr, Goldfader P. Head injury, a multivariate study: Predicting long-term productivity and independent living outcome [see comments]. Brain Inj. 1989; 3: 36985. [PubMed]
Vollmer DG, Torner JC, Jane JA, et al. Age and outcome following traumatic coma: Why do older patients fare worse? J Neurosurg. 1991; 75(Suppl): S3749.
Walker WC, Kreutzer JS, Witol AD. Level of care options for the low-functioning brain injury survivor. Brain Inj. 1996; 10: 6575. [PubMed]
Wax W, MacKenzie E, Rice D. Head injuries: Costs and consequences. J Neurosurg. 1991; 48: 6738.
Waxman K, Sundine MJ, Young RF. Is early prediction of outcome in severe head injury possible? Arch Surg. 1991; 126(10): 123741; discussion 1242. [PubMed]
Weddell R, Oddy M, Jenkins D. Social adjustment after rehabilitation: A two year follow-up of patients with severe head injury. Psychol Med. 1980; 10(2): 25763. [PubMed]
Wehman P, West M, Fry R, et al. Effect of supported employment on the vocational outcomes of persons with traumatic brain injury. Special Issue: Supported employment. J Appl Beh Anal. 1989; 22(4): 395405. [PubMed]
Wehman PH, Kreutzer JS, Stonnington HH, et al. Supported employment for persons with traumatic brain injury: A preliminary report. J Head Trauma Rehabil. 1988; 3(4): 8293.
Wehman PH, Kreutzer J, West M, et al. Employment outcomes of persons following traumatic brain injury: Pre-injury, post-injury, and supported employment. Brain Inj. 1989; 3(4): 397412. [PubMed]
Wehman PH, Kreutzer JS, Sale P, et al. Cognitive impairment and remediation: Implications for employment following traumatic brain injury. J Head Trauma Rehabil. 1989; 4(3): 6675.
Wehman PH, Kreutzer JS, West MD, et al. Return to work for persons with traumatic brain injury: A supported employment approach. Arch Phys Med Rehabil. 1990; 71: 104752. [PubMed]
Wehman PH, Revell WG, Kregel J, et al. Supported employment: An alternative model for vocational rehabilitation of persons with severe neurologic, psychiatric, or physical disability. Arch Phys Med Rehabil. 1991; 72(2): 1015. [PubMed]
Wehman PH, Sherron P, Kregel J, et al. Return to work for persons following severe traumatic brain injury. Supported employment outcomes after five years. Am J Phys Med Rehabil. 1993; 72(6): 35563. [PubMed]
West M, Fry R, Pastor J, et al. Helping postacute traumatically brain injured clients return to work: Three case studies. Int J Rehabil Res. 1990; 13: 2918. [PubMed]
West M, Wehman P, Kregel J, et al. Costs of operating a supported work program for traumatically brain-injured individuals. Arch Phys Med Rehabil. 1991; 72: 12731. [PubMed]
Whitlock JA Jr. Functional outcome of low-level traumatically brain-injured admitted to an acute rehabilitation programme. Brain Inj. 1992; 6(5): 44759. [PubMed]
Whitlock JA Jr, Hamilton BB. Functional outcome after rehabilitation for severe traumatic brain injury. Arch Phys Med Rehabil. 1995; 76(12): 110312. [PubMed]
Wilson B. Recovery and compensatory strategies in head injured memory impaired people several years after insult. J Neurol Neurosurg Psychiatry. 1992; 55: 17780. [PubMed]
Wilson BA. Syndromes of acquired dyslexia and patterns of recovery: A 6- to 10-year follow-up study of seven brain-injured people. J Clin Exp Neuropsychol. 1994; 16: 35471. [PubMed]
Wilson BA, Evans JJ, Emslie H, et al. Evaluation of NeuroPage: A new memory aid. J Neurol Neurosurg Psychiatry. 1997; 63: 1135. [PubMed]
Wood RL. Rehabilitation of patients with disorders of attention. J Head Trauma Rehabil. 1986; 1: 4353.
Wood RL, Fussey I. Computer based cognitive retraining: A controlled study. Int Disabil Studies. 1987; 9: 14953. [PubMed]
Woolf PD, Hamill RW, Lee LA, et al. The predictive value of catecholamines in assessing outcome in traumatic brain injury. J Neurosurg. 1987; 66(6): 87582. [PubMed]
Woolf SH, Battista RN, Anderson GM, et al. Assessing the clinical effectiveness of preventive maneuvers: Analytic principles and systematic methods in reviewing evidence and developing clinical practice recommendations. A report by the Canadian Task Force on the Periodic Health Examination. J Clin Epidemiol. 1990; 43: 891905. [PubMed]
Wrigley JM, Yoels WC, Webb CR, et al. Social and physical factors in the referral of people with traumatic brain injuries to rehabilitation. Arch Phys Med Rehabil. 1994; 75(2): 14955. [PubMed]
Ylvisaker M, Feeney TJ. Executive functions after traumatic brain injury: Supported cognition and self-advocacy. Semin Speech Lang. 1996; 17(3): 21732. [PubMed]
Zafonte RD, Hammond FM, Mann NR, et al. Relationship between Glasgow Coma Scale and functional outcome. Am J Phys Med Rehabil. 1996; 75: 3649. [PubMed]
Zafonte RD, Hammond FM, Mann NR, et al. Revised trauma score: An additive predictor of disability following traumatic brain injury? Am J Phys Med Rehabil. 1996; 75: 45661. [PubMed]
Footnotes
1

Use of language in reference to people with TBI is based on a survey of current usage. "Survivor" isused through the course of a person's life. "Patient" is used when the person is an inpatient. "Client" is used in general outside the patient setting. Otherwise,"a person (or people) with TBI" is the preferred term.

Help ǀ Contact Bookshelf
AHRQ Evidence Reports
(navigation arrows) Go to previous chapter Go to next chapter Go to top of this page Go to bottom of this page Go to Table of Contents