Source: MMWR - Morbidity and Mortality Weekly Report. 46(1):8-11, 1997 Jan 10.
The authors thank the members of the Brain Injury Support Group of Portland for their support and the use of their library. They also thank the Portland State University Capstone students who volunteered their time to help with the project: Heather Brooks, Samantha Cohen, Justin Davis, Cynthia Davis-O'Reilly, Julie Geil, Cheryl Matsumura, and Jeana Schoonover.
The American Academy of Family Practice provided the model, its Clinical Policy Review Form, on which the authors based their review form for this report.
The Agency for Health Care Policy and Research (AHCPR), through its Evidence-based Practice Centers (EPCs), sponsors the development of evidence reports and technology assessments to assist public- and private-sector organizations in their efforts to improve the quality of health care in the United States. The reports and assessments provide organizations with comprehensive, science-based information on common, costly medical conditions and new health care technologies. The EPCs systematically review the relevant scientific literature on topics assigned to them by AHCPR and conduct additional analyses when appropriate prior to developing their reports and assessments.
To bring the broadest range of experts into the development of evidence reports and health technology assessments, AHCPR encourages the EPCs to form partnerships and enter into collaborations with other medical and research organizations. The EPCs work with these partner organizations to ensure that the evidence reports and technology assessments they produce will become building blocks for health care quality improvement projects throughout the nation. The reports undergo peer review prior to their release.
AHCPR expects that the EPC evidence reports and technology assessments will inform individual health plans, providers, and purchasers as well as the health care system as a whole by providing important information to help improve health care quality.
We welcome written comments on this evidence report. They may be sent to: Director, Center for Practice and Technology Assessment, Agency for Health Care Policy and Research, 6010 Executive Blvd., Suite 300, Rockville, MD 20852.
| Douglas B. Kamerow, M.D. Director, Center for Practice and Technology Assessment Administrator Agency for Health Care Policy and Research | John M. Eisenberg, M.D. Administrator Agency for Health Care Policy and Research |
| The authors of this report are responsible for its content. Statements in the report should not be construed as endorsement by the Agency for Health Care Policy and Research or the U.S. Department of Health and Human Services of a particular drug, device, test, treatment, or other clinical service. |
Objective. To examine the evidence for effectiveness of rehabilitation methods at various phases in the course of recovery from traumatic brain injury (TBI) in adults. Specifically, we addressed five questions about the effectiveness of (1) early rehabilitation in the acute care setting, (2) intensity of acute inpatient rehabilitation, (3) cognitive rehabilitation, (4) supported employment, and (5) care coordination (case management).
Search Strategy. A MEDLINE search (1976 to 1997), supplemented by searches of HealthSTAR (1995 to 1997), CINAHL (1982 to 1997), PsycINFO (1984 to 1997), and reference lists of key articles.
Selection Criteria. Broad inclusion criteria were defined for screening eligible abstracts. Two reviewers read each abstract to determine its eligibility. Full articles were included if they met methodologic criteria and were relevant to one of the causal links identified for each major question. Specifically, we included all comparative (controlled) studies, as well as uncontrolled series that had information about the short- or long-term outcomes associated with rehabilitation for traumatic brain injury.
Data Collection and Analysis. We developed an instrument to record data abstracted from each eligible article. The instrument includes items for patient characteristics, interventions, co-interventions, outcomes, study methods, relevance to the specific research questions, and results of the study. We used a three-level system to rate individual studies. Well-designed randomized controlled trials (RCTs) were rated as Class I. RCTs with design flaws, well-done, prospective, quasiexperimental or longitudinal studies, and case-control studies were rated as Class II. Case reports, uncontrolled case series, and expert or consensus opinion were generally rated Class III. Comparative studies that met inclusion criteria were critically appraised and summarized in evidence tables.
Main Results. A total of 3,098 references were specified for inclusion. After removal of duplicates, 569 applied to questions 1 and 2, 600 applied to question 3, 392 applied to question 4, and 975 applied to question 5. Eighty-seven articles pertaining to questions 1 and 2, 114 articles for question 3, 93 articles for question 4, and 69 articles for question 5 passed the eligibility screen. Sixty-seven additional articles were recommended for inclusion by experts or were obtained from reference lists of review articles. There was weak evidence from Class III studies that early rehabilitation during the acute admission reduces the rehabilitation length of stay. Studies of the intensity of acute inpatient rehabilitation had inconsistent results and used study designs that, despite appropriate use of statistical methods to adjust for severity, had serious limitations because of confounders. Controlled trials of cognitive rehabilitation had mixed results, with the strongest evidence (Class I) supporting the use of prosthetic aids to memory. Well-done, prospective observational studies (Class II) support the use of supported employment within the context of well-designed, well-coordinated programs. From one Class II clinical trial, there was no support for case management, but two well-done Class III studies support the use of case management to produce functional improvements.
Conclusions. Population-based studies are needed to examine the overall impact of TBI and the differences in outcomes associated with different rehabilitation strategies. Future studies of cognitive rehabilitation and case management should focus on health outcomes of importance to people with TBI and their families.
This document is in the public domain and may be used and reprinted without permission.
Suggested Citation:
Chesnut RM, Carney N, Maynard H, et al. Rehabilitation for traumatic brain injury. Evidence report no. 2 (Contract 290-97-0018 to Oregon Health Sciences University). Rockville, MD: Agency for Health Care Policy and Research. February 1999.
Advances in medical technology and improvements in regional trauma services have increased the number of survivors of traumatic brain injury (TBI), producing the social consequences and medical challenges of a growing pool of people with disabilities. Wider awareness of the scope of the problem and its consequences for society has led to rapid growth in the rehabilitation industry. Because of this growth and particularly because clinical rehabilitation strategies vary widely, many groups are interested in the effectiveness of rehabilitation for TBI.
To address this need to identify and assess evidence on TBI rehabilitation, the Agency for Health Care Policy and Research awarded a contract to Oregon Health Sciences University for a review of published reports and compilation of an evidence report. This summary highlights information presented in the full report.
Injury is the leading cause of mortality among Americans under 45 years of age; TBI is responsible for the majority of these deaths. An estimated 56,000 lives are lost in the United States each year to TBI. Motor vehicle accidents, followed by gunshot injuries and falls, are the leading causes of injuries resulting in death from TBI. Males are 3.4 times as likely as females to die of TBI. About 50 percent of people who sustain TBI are intoxicated at the time of injury.
In a recent analysis based on hospital discharge data and vital statistics, the annual incidence of TBI in the United States was estimated to be 102.8 per 100,000. In males, the incidence peaks between the ages of 15 and 24 (248.3 per 100,000) and again above 75 years of age (243.4 per 100,000). The incidence in females peaks in the same age groups, but the absolute rates are lower (101.6 and 154.9, respectively). These rates underestimate the true incidence of head trauma because patients with milder symptoms at the time of injury usually are not hospitalized.
About three-quarters of traumatic brain injuries that require hospitalization are nonfatal. Each year, about 80,000 survivors of TBI will incur some disability or require increased medical care. Direct medical costs for TBI treatment have been estimated at $48.3 billion per year, including the costs of hospitalization for acute care and various rehabilitation services. In the years 1988 to 1992, reports of average length of stay (LOS) for the initial admission for inpatient rehabilitation range from 40 to 165 days. In one multicenter study (the Model Systems study), the average rehabilitation LOS was 61 days, and the average charge was $64,648 exclusive of physician fees. Total charges averaged $154,256. In more recent studies performed in the early 1990s, rehabilitation LOS and charges were lower, ranging from 19 days and $24,000 for patients with milder injuries to 27 days and $38,000 for those with severe injuries. In the Medicare population in 1994, mean charges for patients admitted for brain injury (excluding stroke) were $42,056.
To focus attention on important questions, the life of an adult survivor of TBI was characterized by the developers of the report in terms of five phases. The first phase is pre-injury. Medical treatment is divided into two phases: the acute (or immediate) treatment phase and the intensive treatment phase, lasting days to weeks. The rehabilitation phase may last months to years. The survivor phase implies the remaining life of the person with TBI and involves continual development and adjustment. This division into phases clarifies the three challenges to assessing the efficacy of rehabilitation discussed above. For each phase, patient populations, interventions, and outcome measures were identified, and the literature was reviewed to answer key questions identified by technical experts.
The following three questions about the status of brain injury research underlie uncertainty about the effectiveness of rehabilitation services.
How should fundamental concepts such as recovery, functional status, and disability be defined? Because brain function is highly complex, TBI has an extremely wide range of potential outcomes, including cognitive deficits, motor disabilities, emotional and social dysfunction, personality changes, and changes in appearance. As a result, therapeutic aims and perspectives vary widely among studies, as do definitions of outcomes, making valid comparisons across studies difficult.
How should the type and severity of the injury itself be measured? Variations in methods to assess the severity of injury in patients entering rehabilitation make it difficult to estimate the effectiveness of different rehabilitation methods.
Which therapies are effective, and what is the best way to match patients with treatment approaches likely to be effective for them?
Today, a person's path to rehabilitation after sustaining brain injury may be determined by the mechanism of injury, the resources of the community, the person's employment or financial status, the consent of the family, and/or the accuracy of the emergency department diagnosis. While a few metropolitan areas have organized referral systems that connect patients with resources and rehabilitation programs, systematic methods for evaluating the needs of people who have sustained brain injury and referring them to appropriate programs are unusual. Without knowing the efficacy of rehabilitation methods in their specific applications, systematic referral that produces the desired result is not possible.
Two panels of experts worked with the research team to identify key questions in the rehabilitation and survivor phases for adults with TBI. The first panel was composed of two physiatrists, a survivor of TBI, the wife of a survivor of TBI, a State vocational rehabilitation counselor, a neuropsychologist, a psychologist, a clinical coordinator of an outpatient TBI rehabilitation program, and a rehabilitation clinical nurse specialist, all from the Portland, OR, area. The second panel was composed of nationally recognized experts in rehabilitation.
The panels formulated five questions pertaining to the phases of recovery described above. These questions addressed the effectiveness of (1) early rehabilitation in the acute care setting (timing), (2) intensity of rehabilitation, (3) cognitive rehabilitation, (4) supported employment, and (5) care coordination (case management). For each of these questions, members of the research team worked with panelists to write a brief rationale for the question, define key terms, and specify the relevant patient populations, interventions, and outcome measures to be examined in the literature review. The questions were:
Should interdisciplinary rehabilitation begin during the acute hospitalization for traumatic brain injury?
Does the intensity of inpatient interdisciplinary rehabilitation affect long-term outcomes?
Does the application of cognitive rehabilitation enhance outcomes for people who sustain TBI?
Does the application of supported employment enhance outcomes for people with TBI?
Does the provision of long-term care coordination enhance the general functional status of people with TBI?
A MEDLINE search (1976 to 1997), supplemented by searches of HealthSTAR (1995 to 1997), CINAHL (1982 to 1997), and PsycINFO (1984 to 1997), produced a total of 3,098 references to be considered for inclusion; of these, 569 applied to questions 1 and 2, 600 applied to question 3, 392 applied to question 4, and 975 applied to question 5.
Abstracts of each article retrieved by these searches were reviewed independently by two members of the research team, who applied predefined, broad eligibility criteria. When the two reviewers disagreed, a third reviewer read the abstract and cast the deciding vote on whether it should be included. In the event a reference did not have an abstract, and the title for the reference was not sufficient for determination of status, the article was retrieved and reviewed to determine its eligibility. The two reviewers examined each abstract and indicated whether it met the inclusion criteria and, if not, the reason for exclusion. If the abstract was eligible, or if it did not contain sufficient information to determine eligibility, the full text of the article was retrieved for review in the next phase of the selection process.
Eighty-seven articles pertaining to questions 1 and 2, 114 articles for question 3, 93 articles for question 4, and 69 articles for question 5 passed the eligibility screen. Sixty-seven additional articles were recommended for inclusion by experts or by review of reference lists of review articles. In all, 363 articles were retrieved for review and abstraction.
Additional criteria for inclusion were defined separately for each of the five questions. The criteria varied because the necessary types of studies varied from question to question. Articles that applied to more than one question were maintained as duplicates (or triplicates, etc.) in each question-specific file, so they could be considered for inclusion based on their relevance to each question.
An instrument was designed to record data abstracted from each eligible article. The instrument includes items for patient characteristics, interventions, cointerventions, outcomes, study methods, relevance to the specific research questions, and results of the study. The instrument has two components: the first three pages of the instrument apply to all articles specified for inclusion in the study; the remaining pages are individual instruments that apply to one of the five questions. To abstract an article, a reader used the initial abstraction instrument plus one or more of the five question instruments.
The first few questions of the initial abstraction instrument allowed the reviewer to determine if the article actually met the eligibility criteria for inclusion in the report. If an article was determined to be ineligible, it was passed to a second reader for confirmation. The remaining articles were subjected to the full abstraction protocol.
A three-level system was used to rate individual studies. Well-designed randomized controlled trials (RCTs) were rated as Class I. Studies rated as Class II were RCTs with design flaws; well-done, prospective, quasiexperimental or longitudinal studies; and case-control studies. Case reports, uncontrolled case series, and expert or consensus opinion were generally rated Class III. A well-done, prospective, multicenter or population-based case series can provide valuable information that, in some ways, is more reliable than data from a randomized trial done in a highly selected sample of patients. However, when used to make inferences about effectiveness, an uncontrolled case series is generally classified as Class III, indicating the lowest level of confidence.
A "gray zone" exists between Class II and definite Class III articles. Much of the research in rehabilitation uses quasiexperimental designs. In these observational study designs, control subjects are sometimes identified from a separate patient population. For instance, one group of researchers compared patients undergoing inpatient rehabilitation to a sample of people with TBI who had been treated in a region of the country where formal inpatient TBI rehabilitation was not available. This was an entirely separate patient group, and all the data except outcome measures came from an independent database.
The main difficulty with the quasi-experimental design is lack of control over the constitution of the compared groups. Because there is no randomization and generally no control over the details of the selection process through which the patients received their separate therapies, the groups are likely to differ in the frequency of characteristics that are associated with the outcomes of interest. Even when significant efforts are made to match the experimental and the quasi-control groups, it is likely that significant differences between the groups will remain.
Much of the literature relevant to the five questions addressed in this effort falls into the "gray zone" between Class II and Class III. For this reason, critical appraisal of key studies played a particularly important role in this review. A number of characteristics of these studies were considered relevant to all rehabilitation questions and were recorded in the data abstraction form. Evaluation of the following factors played a major role in critically appraising these articles:
Prospective collection of data.
Complete description of parent study population.
Large study population (driven by hypothesis, power, type I error threshold).
Study setting--a single center, many centers, or population based.
Description of reasons for referral to service being studied.
Description of methods sufficiently complete to permit study replication.
Complete description of rehabilitation technique in question (independent variable).
Complete description of differences between "control" and "experimental" groups.
Conditions determining whether patients did or did not receive the rehabilitation technique in question.
Information about potential confounders, including types and severity of injury, age, and others (including, in some cases, economic status, educational level, lack of family support).
Measurement of confounding variables using instruments validated as accurate, sensitive, and reliable.
Payer group.
Choice of outcome variables that are meaningful to patients and caregivers.
Use of functional status and other health outcomes rather than surrogate (intermediate) outcomes.
Measurement of outcome variables using instruments validated as accurate, sensitive, and reliable.
Timing of outcome measurements.
Assessment of patient characteristics and outcomes by blinded observer.
Use of multivariate statistical analysis: Were interactions sought and controlled for? Were risk estimates calibrated? Were all relevant confounders included as candidate variables?
The criteria used to classify articles and the features to be considered in critically appraising them were discussed at the subcommittee, committee, national expert panel, and Aspen Neurobehavioral Conference levels with the goal of maintaining consensus at least on the relative stratification of individual articles.
Evidence tables were constructed to summarize the best evidence about effectiveness pertaining to each question. No randomized trials and only a few quasiexperimental studies were available for questions 1 and 2. There were a large number of relevant observational studies of important relationships (for example, the relation of patient characteristics to outcome); studies that concerned individual causal links or relationships in evidence tables were not summarized. For question 3, addressing cognitive rehabilitation, 15 randomized controlled trials and comparative studies that met specified inclusion criteria were placed into evidence tables. All comparative studies located for the last two questions, which addressed supported employment and care coordination, were included in evidence tables.
For each of the five questions, subcommittees were formed consisting of one or two members of the research team and one or two members of the local technical panel. Each subcommittee was chaired by a member of the research team. Key articles relevant to the assigned question were reviewed in depth by all members of the subcommittees. These reviews were discussed among the various members of the subcommittees, and the results were summarized by the chair. This was an effort to ensure that the summary statements on the research questions reflected the expertise and experience of a variety of technical experts with relevant skills and training. These interpretive efforts addressed the methods and results of individual studies, their rating, and their scientific importance.
All of the critical articles for the five questions were individually read by the principal investigator. Summaries were presented and discussed with national experts at the Aspen Neurobehavioral Conference in April 1998.
One small, retrospective, observational study from a single rehabilitation facility supports an association between the acute institution of formalized, multidisciplinary, physiatrist-driven TBI rehabilitation and decreased length of stay (acute hospital and acute rehabilitation) and some measures of short-term physiologic (noncognitive) patient outcomes. The level of evidence is Class III. This study concerned adult patients with severe brain injury (Glasgow Coma Scale 3-8); there is no evidence from comparative studies for or against early rehabilitation in patients with mild and moderate injury.
When measured as the hours of application of individual or grouped therapies, there is no indication that the intensity of acute, inpatient TBI rehabilitation is related to outcome. Because of methodological weaknesses, however, previous studies are likely to have missed a significant relationship if one exists (a Type II error). These studies contained insufficient information about severity of injury and baseline function to ensure the comparability of compared groups. Also, these studies did not consider the quality of individual treatments, their lack of autonomy in the cognitive realm, and the delivery milieu. One or more of these factors may affect the outcome of care more than the time spent in each modality. Therefore, future research into efficacy of acute inpatient TBI rehabilitation must more adequately measure such factors and include the factors in their predictive models. Future studies also must employ a wider spectrum of outcome measures, including measurement of outcomes across longer periods of time after discharge.
From a clinical aspect, the evidence does not support equating different TBI rehabilitation delivery systems based on equivalent times of patient exposure to various therapeutic modalities. For example, this analysis would not support predicting that patient benefit would be equal if an equal time spectrum of rehabilitation therapies were delivered at a rehabilitation center as compared with a skilled nursing facility. More detailed analysis of factors involved in predicting response to rehabilitation modalities must be considered in approaching such questions.
Additionally, mandating a minimum number of hours of applied therapy for all TBI patients is not supported by the present state of scientific knowledge. How much of which intervention(s) optimizes recovery in a given type of patient has been inadequately studied. It is certainly reasonable to avoid situations in which patients do not receive potentially beneficial treatment. Based on the above studies, however, defining a minimal rehabilitation program in terms of time of applied therapy is not likely to optimize either the therapists' time or patients' recovery. It is probable that specific basic programs will have to be related to individual patient groups. Developing such algorithms requires further research.
Many patients who suffer TBI do not enter acute inpatient rehabilitation. Only one study of the effectiveness of inpatient rehabilitation included a comparison group of patients who did not undergo inpatient rehabilitation. Future studies should compare acute, inpatient rehabilitation to commonly used alternatives to inpatient rehabilitation, such as care in a well-staffed skilled nursing facility or in less intense variations of acute rehabilitation. Very little is known about the outcomes of TBI in these settings.
There is evidence from two small studies (Class I and Class III) that a personally adapted electronic device, a notebook, and an alarm wristwatch reduce everyday memory failures for people with TBI. There is evidence from one study (Class II[a]) that compensatory cognitive rehabilitation (CCR) reduces anxiety and improves self-concept and relationships for people with TBI. Evidence from two studies (Class I and Class II[b]) supports the use of computer-aided cognitive rehabilitation (CACR) to improve immediate recall on neuropsychological testing, but the clinical importance of this finding has not been validated.
Class II evidence indicates that supported employment can improve the vocational outcomes of TBI survivors. Nearly all information about supported employment comes from two bodies of work, each of which used different experimental designs and different models of supported employment. The findings have not been replicated in other settings or by other centers, so the generalizability of these programs remains untested.
There have been very few studies on the effectiveness of case management, and the results of these studies are mixed. The only outcome for which there were results in the same direction from two or more studies pertained to changes in vocational status. This was associated with the single case-manager and insurance approach, as well as with the combined nurse and vocational case-manager model. There were conflicting results about the effects of case management on disability or functional status, living status, family impact, and other aspects, and some findings were mentioned in only one study. The clinical trial resulted in no functional status changes among case-managed subjects, despite an extended period of rehabilitation. However, when two forms of case management were compared, both the single and multiple case-manager/insurance approaches showed significant functional improvements.
The evidence report identifies the following areas for future research.
Randomized trials of the timing and intensity of early and acute rehabilitation would be useful. Because the patient characteristics that affect outcomes also affect the type and level of rehabilitation services delivered, it may be unlikely that any observational study can provide definitive evidence about effectiveness. Moreover, assigning patients to different levels of intensity or to early versus conventional initiation of rehabilitation in a prospective trial may be ethically acceptable, since these different levels represent a range of current practice rather than a deviation from it.
Population-based studies of all patients with TBI, including those who do not enter inpatient rehabilitation facilities, are imperative. Important questions about the effectiveness of rehabilitation and its component disciplines require the development of regional or national registries, with standardized data collection and identification and followup of all patients with head injury.
Research designs for future studies should incorporate health outcomes of importance to people with TBI and their families. Commonly used measures should be more strongly linked to health outcomes. Future studies should address the effect of spontaneous recovery, systematize criteria for entering cognitive rehabilitation, and differentiate between the effects of general stimulation and specific techniques.
The greatest overall need for the evaluation of supported employment programs is a series of trials with adequate controls and unbiased allocation of clients to the conditions compared.
Future research should focus on improving the outcome measures used to examine the results of case management in TBI rehabilitation. In addition to outcomes of changed patient functionality, there should be outcomes of changed family functionality. Since much of case management communication is directed toward helping family members learn what to expect and where to obtain services, relevant outcomes would include family use of community and rehabilitation services and indicators of family assertiveness about care expectations. While case management may exert only an indirect effect on a patient's functional outcomes such as level of disability, vocational status, and living status, it is possible that case management can directly affect family knowledge of TBI rehabilitation needs and services, level of psychosocial anxiety, and family competency in coping with TBI.
An estimated 4.5 million people in the United States are disabled as a result of traumatic brain injury (Centers for Disease Control and Prevention [CDC], 1998). Advances in medical technology and improvements in regional trauma services have increased the number of survivors1 of traumatic brain injury (TBI), producing the social consequences and medical challenges of a growing pool of people with disabilities (Annoni, Beer, and Kesselring, 1992; Ewing, Thomas, Sansces, et al., 1983). Lifelong disability is the consequence for 80,000 to 90,000 individuals each year (CDC, 1998). As a result, answers to questions about recovery are being pursued through a multitude of research projects by various communities with distinct objectives.
Wider awareness of the scope of the problem and its consequences for society has led to rapid growth in the rehabilitation industry. Because of this growth, and particularly because clinical rehabilitation strategies vary widely, many groups are interested in the effectiveness of rehabilitation for TBI.
Rehabilitation experts have recognized the inadequacy of applying traditional models, effective with broken arms or legs, to the task of recovery from brain injury and cerebral tissue damage.
Payers have begun to recognize the inadequacy of current standards for funding rehabilitation from brain injury; they want to know what long-term outpatient programs are most likely to return a person to functional independence; when specific types of rehabilitation should start and when they should end; and which components of complex, multidisciplinary rehabilitation programs are effective.
Congress has raised questions about unmet needs for rehabilitation services, the adequacy of care in existing facilities, and the relative costs and effectiveness of the wide variety of rehabilitation services offered to survivors of TBI.
A strong and growing advocacy movement of survivors of TBI and their families has a research agenda that includes defining recovery and functional status in terms of quality of life as well as financial independence.
Three questions about the status of brain injury research underlie uncertainty about the effectiveness of rehabilitation services. First, how should fundamental concepts such as recovery, functional status, and disability be defined? Because brain function is highly complex, TBI has an extremely wide range of potential outcomes, including, for example, cognitive deficits, motor disabilities, changes in emotional and social function, personality changes, and changes in appearance. As a result, therapeutic aims and perspectives vary widely among studies, as do definitions of outcomes, making valid comparisons across studies difficult.
Second, how should the type and severity of the injury itself be measured? Variation in methods to assess the severity of injury in people entering rehabilitation make it difficult to estimate the effectiveness of different methods of rehabilitation.
Third, which therapies are effective, and how can patients best be matched to treatment approaches likely to be effective for them? Today, a person's path to a rehabilitation program after sustaining brain injury may be determined by the mechanism of injury, the resources of the community, the person's employment or financial status, the consent of the family, and/or the accuracy of emergency department diagnosis. While a few metropolitan areas have organized referral systems that connect people with TBI with resources and rehabilitation programs, systematic methods for evaluating the needs of those who have sustained brain injury and referring them to appropriate programs are unusual. Without knowing the efficacy of rehabilitation methods in their specific applications, systematic referral that produces the desired result is not possible.
Another major theme in the literature and in public discourse concerns the costs associated with traumatic brain injury and the cost-effectiveness of its treatment. The clinical economic problem posed by people with TBI is how much to invest in their rehabilitation after it is clear they will survive their injuries. Our ability to maximize the return on this investment is limited by a lack of accurate information about the costs of TBI and the costs and benefits associated with various treatments.
Given the current interest in the effectiveness of rehabilitation for TBI, the Agency for Health Care Policy and Research (AHCPR) selected this topic as one to be investigated by an Evidence-based Practice Center (EPC). AHCPR selected Oregon Health Sciences University (OHSU) to produce the evidence report. The OHSU EPC found a partner in the planning committee for the Consensus Development Conference on Rehabilitation of Persons with Traumatic Brain Injury, sponsored by the National Institutes of Health and held in October 1998. In addition, the Brain Injury Association, Inc., an organization with a mission to support research leading to better outcomes for people who sustain a brain injury, indicated their willingness to serve as a partner with the OHSU EPC in the development of this evidence report.
In this report, we examine available evidence about the effectiveness of rehabilitation for adult survivors of TBI. Specifically, we report the results of a systematic effort to identify the best available evidence about the various strategies to improve the outcome of traumatic brain injury in the most common rehabilitation settings. The main attribute of a systematic review is the application of methods designed to avoid the biases inherent in less formal approaches to reviewing the literature. For example, to avoid bias in the identification and selection of articles, a systematic review uses predefined search strategies and explicit criteria for inclusion or exclusion of studies. This approach can uncover published evidence that might be ignored in an informal review in which studies that are widely known or that support a particular viewpoint are more likely to be identified. Similarly, a systematic review applies methods to reduce bias in interpreting studies, such as review by more than one investigator and the use of a data abstraction form.
In addition to being systematic, we employed methods to assess the methodologic strength of individual studies and the strength of evidence supporting assertions about the effectiveness of interventions. The strongest evidence for effectiveness comes from experimental studies, in which subjects are randomly assigned to alternative interventions. In many cases, inferences about effectiveness are drawn from the results of uncontrolled, or poorly controlled, cohort studies. In these observational studies, a group of subjects is followed over time. Such studies are particularly useful for describing the incidence of certain outcomes over time and for analyzing the relationship between risk factors and those outcomes. However, observational studies often provide weak or flawed evidence about effectiveness, because it is not clear if the observed outcomes resulted from specific interventions or if they would have occurred anyway in the absence of the intervention.
How should the information in this report be used? Our main goal is to provide a guide to the strengths and limitations of the evidence about these interventions that organizations can use to develop evidence-based practice guidelines and other tools for rehabilitation. Another goal is to identify information gaps and controversies that can be addressed in future research studies. A finding that a particular treatment is proven effective or proven ineffective may dominate a discussion about what should be done. Most findings, however, are in between--i.e., "not proven" rather than "proven not." In these situations, factors other than the strength of evidence should be considered in deciding on a clinical recommendation. Patient and societal preferences and values such as equity, attitudes about risk, and evidence about the relative benefits and harms should be considered in making a recommendation about practice.
TBI is the leading cause of death and disability among children and young adults in the United States (CDC, 1998). An estimated 56,000 lives are lost in the United States each year to TBI (Kraus and McArthur, 1996). Motor vehicle accidents, followed by injuries due to firearms and falls, are the leading causes of death from TBI (Sosin, Sniezek, and Waxweiler, 1995). Males are 3.4 times as likely as females to die of TBI (National Institute of Neurological Disorders and Stroke). About 50 percent of people who sustain TBI are intoxicated at the time of injury (Ruff, Marshall, Klauber, et al., 1990; Kreutzer, Doherty, Harris, et al., 1990).
Source: MMWR - Morbidity and Mortality Weekly Report. 46(1):8-11, 1997 Jan 10.
| Type of costs | Cost definitions |
|---|---|
| Direct personal care costs | All additional costs of supported living arrangements required by the person with TBI relative to independent community living. |
| Direct family out-of-pocket costs | Copayments and deductibles for covered health care services, expenses for uncovered health care services, child care expenses while attending rehabilitation, child care costs due to inability of patient to care for child, transportation to/from rehabilitation, cost of home renovation to adapt to the needs of the person with TBI (e.g., wheelchair access, installing a bathroom on a main floor). |
| Indirect medical care and rehabilitation costs | Travel time receiving rehabilitation treatment, waiting time, time spent by caregivers, family members, or friends in providing care. |
| Lost productivity | Lost productivity for the person with TBI and caregiver(s) because of the person with TBI. |
| Friction costs | Transaction costs (e.g., hiring, training) associated with replacement of a worker. |
| Insurance | Loading fees (profit and claims administration costs) for health and liability insurance, increase in experience-rated health insurance premiums for people with TBI subsequent to their injuries. |
| Education | Costs of formal retraining of workers with TBI into former or new jobs because of their disabilities. |
| Social welfare | Administrative costs of social welfare system to determine eligibility and set up transfer payments for income maintenance, direct publicly financed treatment (rehabilitation and sheltered living arrangements), and health insurance. |
| Consumer auto modifications | Costs of modifications to automobiles driven by people with TBI to install adaptive devices to compensate for impairments. |
| Legal/justice system | Costs of the tort liability system for determining the compensatory damages for TBI resulting from negligence; costs of the tort system for appealing decisions from the social welfare system relating to income maintenance for people with TBI. |
| Pain, suffering, bereavement | Bodily pain and unobservable psychological and emotional distress for people with TBI and their families caused by the injury, its treatment, and the associated loss of functioning. Note that these costs are separate from the lost productivity effects associated with chronic pain and emotional distress. Ideally, these effects would be valued by a person's willingness to pay to avoid these TBI symptoms. |
Note: Shading in the cells denotes the settings of treatment phase or application of techniques in that phase. Grid shading denotes greater correlation of phase with setting or technique.
Although it is difficult to precisely quantify costs, useful information can be gleaned by studying charge data from published studies in various settings. The total cost of traumatic brain injuries in the United States is estimated to be $48.3 billion annually. Hospitalization accounts for an estimated $31.7 billion, whereas fatal brain injuries cost the Nation approximately $16.6 billion (Lewin, 1992).
In recent years, LOS and inpatient costs for rehabilitation have decreased. In the years 1988-1992, reports of average LOS for the initial admission for inpatient rehabilitation range from 40 to 165 days (Blackerby, 1990; Carey, Seibert, and Posavac, 1988; Giacino, Kezmarsky, DeLuca, et al., 1991; Mackay, Bernstein, Chapman, et al., 1992; McMordie and Barker, 1988; Rappaport, Herrero-Backe, Rappaport, et al., 1989). In one older multicenter study (the Model Systems study), the average rehabilitation length of stay (LOS) was 61 days, and the average charge was $64,648 exclusive of physician fees. Total charges averaged $154,256 (Lehmkulh, Hall, Mann, et al., 1993). In more recent studies performed in the early 1990s, rehabilitation LOS and charges were lower, ranging from 19 days and $24,000 for patients with milder injuries to 27 days and $38,000 for those with severe injuries (Cowen, Meythaler, DeVivo, et al., 1995). In the Medicare population in 1994, mean charges for patients admitted for brain injury (excluding stroke) were $42,056 (Chan, Koepsell, Deyo, et al., 1997).
To focus attention on important questions, we characterized the life of a person with TBI in terms of five phases, as presented in Figure 2
In TBI, the disease process begins at the moment of impact and extends thereafter for a protracted period of time. In strictly biological aspects, the brain injury disease process can be divided into primary and secondary insults. The primary insult initiates with the physical trauma to the brain. The secondary insults occur thereafter and, in many cases, are the primary determinants of outcome.
Beginning at impact and continuing for a generally brief period, primary insults to the brain include formation of intracranial hematomas (subdural or epidural), intracerebral hematoma, cerebral parenchymal contusions, cerebral swelling, and/or diffuse axonal injury. Intracranial hematomas such as subdurals and epidurals occur outside of the brain parenchyma and exert much of their pathological effects via increasing pressure on the brain (elevation of intracranial pressure [ICP]). Particularly with respect to epidural hematomas, if this pressure is avoided or rapidly reversed through expedient surgery, there may be no damage to the underlying brain and no residual effects of the hematoma. When there is a period of protracted intracranial hypertension, the ICP elevation may result in herniation of the brain tissue through orifices of the skull and/or cerebral ischemia due to interference with cerebral blood flow. Depending on magnitude and duration, such insults can produce deficits that vary from subtle to mortal.
Subdural hematomas also can cause significant intracranial hypertension and have a high likelihood of damaging underlying brain. This damage is often the primary determinant of long-term recovery.
Similar concerns about ICP are also relevant to cerebral swelling. Intracranial processes such as increased extracellular or intracellular fluid or elevated intracranial blood volume can raise ICP and impair adequate blood flow to the brain. In addition, some of these processes can cause primary cellular damage or ischemia by interfering with oxygen transport between vessels and cells.
Injuries such as intracerebral hematomas and cerebral contusions result in blood intermixed with brain. In the case of contusions, the pathology includes primary damage to neuronal cells. In both instances, the presence of blood within brain tissue appears to have significant toxic effects which can produce profound secondary insults to the injured tissue.
Diffuse axonal injury is a somewhat different disease entity. In this injury type, the physical forces the brain sustains during an injury characteristically consist of linear as well as angular acceleration or deceleration. These forces disrupt axons within the cerebral white matter, and these are called shear injuries. In this injury type, there may be no herniation or intracranial hypertension and, indeed, computer tomographic (CT) studies often may be normal or remarkably benign in appearance. Unfortunately, the widespread damage to the white matter will produce a recovery that is characteristically slow and incomplete.
Primary brain injuries occur at the time of injury and, by definition, must be treated post hoc. Secondary brain injuries are initiated sometime after injury and are often due to systemic factors. Their generally delayed onset allows them to be treated when they occur and also to be forestalled. This aspect of prevention has stimulated many of our trauma protocols and drives significant ongoing pharmaceutical research efforts.
The best known and possibly most devastating secondary brain insult is that of cerebral ischemia due to systemic hypotension. Systemic hypotension is extremely common, occurring in about one-third of patients with TBI during the period of injury through the end of resuscitation. A single hypotensive episode is associated with a doubling of mortality (Chesnut, Marshall, Klauber et al., 1993). Systemic hypotension illustrates the profound influence secondary brain insults can have on recovery and strongly supports the potential benefits of optimal trauma care.
Secondary brain insults may be due to intracranial processes that are initiated by:
Primary brain injury.
Secondary systemic insults such as hypoxia or hypotension.
Injuries to extracranial organ systems.
Systemic complications directly or indirectly related to the initial traumatic incident.
Secondary brain insults arising from the initial trauma include a number of toxic cellular and subcellular biologic processes, including:
Cerebral edema.
Alterations in intracranial ionic homeostasis (e.g., calcium, chloride).
Free radical formation.
Alterations at the molecular biology level.
These processes may result in ongoing and self-perpetuating brain injury. Cerebral edema will interfere with transport of nutrients, oxygen, and waste products and cause injuries to cells surrounding the area of primary injury as well as impair the healing of the initially damaged cells. Alterations in ionic homeostasis will disrupt the transmission properties of the neuronal and neighboring cells. Free radical formation can initiate a self-perpetuating cascade of toxic elements that may damage cells initially untouched by the injury. Finally, alterations at the molecular biology level will interfere with the primary genetic cellular control processes.
Secondary brain insults due to hypoxia or hypotension have become very well recognized over the past two decades and are a primary target of resuscitation protocols. The magnitude of importance of these insults is illustrated by the data on hypotension. Because we now have several tools to effectively recognize and treat such insults that are so devastating, intense interest is currently focused on managing them. Secondary insults also may occur from systemic trauma to extracranial organ systems. Although much of the influence of such extracranial trauma is mediated through hypoxia or hypotension, some aspects are unique to the individual organ system. For instance, long bone fractures may produce fat emboli to cerebral vessels that interfere with cerebral circulation. Alterations in timing and techniques of managing such fractures may improve cerebral outcome by decreasing the risk of embolism.
Finally, cerebral injury can be influenced by systemic complications occurring during the acute phase of management. The most well established of these complications as determinants of outcome include hypotension, pneumonia, sepsis, and coagulopathy. The importance of such factors in determining outcome supports the necessity of excellent critical care in managing patients with TBI.
The biologic aspects of repair or recovery are of primary importance during the early postinjury period, while the cognitive, psychological, and behavioral issues become increasingly predominant over time. The primary processes involved in biologic neuronal recovery are (1) reparative and (2) adaptive or plastic processes. Scientists believe that, except under extremely unusual circumstances, new neurons are not formed in the mature human brain, and thus when a neuron dies, its contribution to brain function is irreparably lost. Since neuronal death apparently can be induced not only by direct trauma but also by traumatic activation of inherent biological processes of programmed cell death (apoptosis), the question of cessation or reversal of such processes is an active focus of research.
Neurons have somewhat limited capabilities of self-repair, but the physiologic underpinnings of this regeneration are not completely understood. Although some clinical evidence suggests that neuronal repair can be facilitated pharmacologically in the injured spinal cord, no clinical evidence suggests that we can favorably influence such processes in the brain.
Research in animals suggests that there are critical periods during recovery wherein interventions may be particularly beneficial. The existence of similar periods has been postulated for the injured human brain, both for biological and behavioral interventions. To date, however, no clinical evidence supports the existence of such critical periods in the human.
Another biologic recovery mechanism is adaptation. In a biologic sense, this involves the formation of new circuitry to replace that lost from trauma. There is a great deal of plasticity in the nervous system, some of which continues throughout the organism's life--for example, learning of new information. At the more macroscopic level of altering neuronal circuits to directly replace those lost, however, abilities seem to be significantly limited in the adult human brain. In the immature nervous system, such plasticity is commonplace. A primary example is the alteration of laterality of language function resulting from very early injury to the left cerebral hemisphere. Unfortunately, the ability to make adaptations of such magnitude is lost early in life and the degree to which plasticity of lesser magnitude persists or can be induced in a more mature brain remains unclear. The question of such plasticity is fundamental to the concept of restorative cognitive therapy as well as to the concept of critical periods.
Neither traumatic brain injury nor its recovery can be described in purely biologic terms. The sudden onset of TBI combines with extreme changes in behavior, personality, memory, and general function to produce a catastrophic perturbation in a person's social system (Goldstein,1995; Johnston and Hall, 1994). Memory deficits and inappropriate behavior limit the ability to return to work (Treadwell and Page, 1996). Personality changes and behavioral problems mimic other pathologies such as mental retardation or psychiatric disorders. These behaviors in turn elicit negative reactions from family and friends that operate to impede the recovery process. Long-term consequences include financial dependence, social isolation (Dikmen, Machamer, and Temkin, 1993), divorce (Lezak, 1995), and various forms of incarceration such as lockup care facilities, State hospitals, or prisons.
The recovery course is partially determined by the presence or absence of factors in the survivor's social context (Goldstein, 1995). Size and strength of immediate and extended family (Kozloff, 1987), access to social services, and adequate resources (both money and programs) (Johnston and Hall, 1994) contribute to the recovery process. Aspects of the survivor's psychology, such as premorbid modes of behavior, may persist after injury (Dikmen, Machamer, and Temkin, 1993), influencing how the survivor engages in the present task of recovery. Drug or alcohol abuse (Sparadeo, Strauss, and Barth, 1990) may provide an alternative to the discomfort of persistent disorientation, confusion, and physical pain.
During the initial phase of recovery, the patient will manifest behaviors that are an immediate attempt to become oriented (Goldstein, 1995). These behaviors are often inappropriate to the context, unexpected, and may appear to be maladaptive. They are a consequence of the patient's sudden reduction in perception of the environment and ability to respond effectively to stimuli. This phase is of primary importance in rehabilitation, in that the milieu must be designed to accommodate the behaviors and not impede them. Attempts to suppress these behaviors may operate to slow the recovery process and keep a patient from engaging a new orientation. However, resistance to odd behaviors is usually a natural response from family and friends. The newly injured patient will often focus on the familiar, usually a family member, to achieve orientation; training the family to respond appropriately is an important component in establishing a context in which the patient can recover (Rosenthal and Young, 1988).
TBI can cause severe cognitive, physical, and psychosocial/behavioral/ emotional dysfunction. The most important cognitive sequelae are memory loss; difficulties with concentration, judgment, communication and planning; and spatial disorientation. Physical problems include abnormalities of muscle tone, vision, hearing, smell, taste, and speech, as well as reduced endurance, headaches, and seizures. Frequently encountered psychosocial/behavioral/emotional problems arising from TBI include anxiety and depression, mood swings, denial, sexual difficulties, emotional lability, egocentricity, impulsiveness and disinhibition, agitation, and isolation. A recent review examined papers describing the psychosocial and emotional sequelae for survivors of TBI (Morton and Wehman, 1995). The results of those studies demonstrated that survivors of severe TBI often lose friendships and social support, have limited opportunities to develop new social contacts and friends, have few leisure activities, and have high levels of anxiety and depression for prolonged periods of time. In addition to the psychosocial problems described above, categories of functional status used to describe outcomes from TBI include memory, mobility and independence, organization and productivity, physical disabilities, and inappropriate behavior.
Brain injury can cause deficits in memory that range from mild, intermittent forgetfulness to profound inability to recall anything from the past or to integrate new information. Cognitive scientists and clinicians have made distinctions in mechanisms of memory that reflect modes of memory loss. Implicit memory records information that occurs nonconsciously; explicit memory is a function of active work such as repetition. Some brain injury depletes implicit memory but not explicit or vice versa. Semantic memory allows for understanding of the meaning of words; episodic memory records time- and place-specific experiences. Procedural memory is reflected in behavioral routines; declarative memory is reflected in the ability to explicitly report.
The burden of illness with respect to memory loss depends on the scope and degree of deficit and is also context-specific. For example, loss of procedural memory may result in devastating occupational consequences to a person whose work tasks are routine. However, if that is the only affected mechanism, other intact modes of memory may substitute for the deficit, and the person may be able to learn a new skill and regain independence.
The inability to integrate new information can result in global loss of independence, especially when accompanied by intact premorbid memory. The individual clearly remembers profession, life circumstances, and family from before the injury but nothing thereafter. Because they do not remember, they do not know that they do not remember, which leads them to insist on a daily and sometimes hourly basis that they are who they used to be. A reminder of the injury may last a minute or a day but will fade with other postmorbid information. These people cannot work, and the burden of their illness is evidenced in the consequences to family and caregivers.
Limitations in mobility and independence may result in the inability to drive or ride a bus, work and earn a living, balance a checkbook, or prepare meals. Mobility also will be affected by physical impairment and independence by degree of memory deficit. The burden is also affected by the individual's social milieu. For example, for one person the presence of family to facilitate mobility may mediate the impact of the trauma; for someone else, dependence on family may be abhorred and may compound the burden of illness.
Many survivors of brain injury exhibit an obsession for orderliness. Some are capable of servicing the obsession to varying degrees. For example, one person's home may be cluttered and disorganized, with one room (a computer room or tool shop) in meticulous order. The burden of illness can be observed in the amount of time and energy devoted to the orderly space and the confusion and lack of productivity experienced in the disorderly environments. Often, on a daily basis, a person never disconnects from the obsessional tasks in order to engage in other productive activities.
Physical deficits include difficulty with ambulation, hearing, vision, speaking, fatigue, and use of the hands. Such deficits may result from injuries sustained at the same time as, but distinct from, the head injury, or they may result directly from brain and spinal column nerve damage.
People with traumatic brain injury often lose the ability to monitor and control behavior (Lezak, 1995). They may say whatever comes to their minds, even at inappropriate times. They may misunderstand the meaning of a situation or conversation and respond according to their misunderstanding. This problem can have profound effects on a person's life, resulting in loss of work, friends, and family.
Rehabilitation methods differ in setting, level, and range of provided therapeutic interventions, durations of treatment, and overall expenses. Lack of standard classification and different aims of therapies are problems in evaluating rehabilitation as an intervention. Three issues complicate classification of interventions:
General versus specific modes of classification. A very general mix of therapies constitutes the protocol of some rehabilitation programs. In contrast, other programs use intricate evaluations to identify deficits and then design interventions specific only to those deficits.
Discipline-driven classification. Another approach to classification of intervention for TBI is to stratify according to the discipline that generates the treatment, such as cognitive rehabilitation, occupational therapy, or physical therapy.
Comparison of intervention categories. In evaluating the effectiveness of a treatment, with what should the treatment be compared? Should inpatient rehabilitation be compared with outpatient, vocational with cognitive? Or should rehabilitation be compared with no rehabilitation?
The specific aims of therapy also vary widely, encompassing interventions aimed at an extremely wide range of potential outcomes, including, for example, cognitive deficits, motor disabilities, changes in emotional and social function, personality changes, and changes in appearance. As a result, therapeutic aims and perspectives vary widely among studies, as do definitions of outcome, making valid comparisons across studies difficult.
Another problem is variation in practice. Allocation of interventions appears to be arbitrary and not necessarily dictated by established standards of practice. A substantial minority (30 to 40 percent) of severely injured patients do not enter rehabilitation, while about 30 percent with mild head injury do. In one study (Dombovy and Olek, 1997), of 48 patients assessed 6 months after discharge from acute care, only 8 had received any postacute rehabilitation.
On a population basis, only a selected subset of patients with TBI undergo inpatient rehabilitation after discharge from the acute care hospital (Wrigley, Yoels, Webb, et al., 1994). Patients seen by a physiatrist during the acute hospitalization were more likely to be provided postacute rehabilitation. The presence or absence of a physiatrist at the hospital was a stronger determinant of referral to inpatient rehabilitation than clinical factors and patient characteristics that would seem to be reasonable criteria for referral (Wrigley, Yoels, Webb, et al., 1994).
| Phases of treatment in TBI | ||||
|---|---|---|---|---|
| Practice settings | Acute | Intensive | Recovery | Survival |
| Coma treatment centers | ||||
| Acute rehabilitation programs | ||||
| Long-term rehabilitation programs | ||||
| Transitional living programs | ||||
| Behavior management programs | ||||
| Day-treatment programs | ||||
| Extended intensive rehabilitation | ||||
| Late rehabilitation | ||||
| Independent living programs | ||||
| Life-long residential | ||||
| Physical therapy | ||||
| Standard rehabilitation (OT, PT, speech) | ||||
| Speech and language therapy | ||||
| Cognitive therapy | ||||
| Occupational therapy | ||||
| Behavioral therapy | ||||
| Psychotherapy | ||||
| Social skills training | ||||
Note: Shading in the cells denotes the settings of treatment phase or application of techniques in that phase. Grid shading denotes greater correlation of phase with setting or technique.
The following are practice settings. Although they are presented separately here, they often overlap to varying degrees.
(Coma) treatment centers--A small number of people with head injuries will remain in a minimally responsive state for months or longer after injury. A few centers will accept such individuals once they are medically stable and attempt to achieve improvement by the use of various stimulation techniques. Skilled nursing care and physical therapy are also important elements of these programs.
Acute rehabilitation programs are prepared to treat patients as soon as they are medically stable and are discharged from the acute hospital. Most of these are located in rehabilitation hospitals. Their primary emphasis is to provide intensive physical and mental restorative services in the early months after injury. Many will have specialized head injury units with an interdisciplinary team composed of physicians, nurses, speech and occupational therapists, and neuropsychologists. These programs are relatively short term, but longer stays may occur.
Long-term rehabilitation programs provide extended rehabilitation and management services. They may provide a full range of rehabilitation services for the person with brain injury who is in need of a structured environment and is making slow improvements. Such programs generally are not for permanent placements, although they may have this service available. Usually a person may remain in the program as long as there continues to be some improvement.
Transitional living programs--The goal of a transitional program is to prepare individuals for maximum independence, teach the skills necessary for community interaction, and work on prevocational and vocational training. Specialized programs stressing cognitive, memory, speech, and behavioral therapies are usually structured to the needs of the individual. Programs of this type are being established in a variety of settings--small group homes, special educational institutions--as part of a continuum of care in rehabilitation centers.
Behavior management programs--Severe maladaptive or aggressive behavior will limit an individual's participation in most rehabilitation settings. While these programs treat the common behavioral problems following head injury, many of them cannot handle destructive behavior to self or others (e.g., sexual aggression).
Day treatment programs are nonresidential facilities that emphasize services to upgrade functional skills. These services are similar to those described above under transitional living programs. Some offer day-care (supervision) services for those unable to benefit from an active program.
Extended intensive rehabilitation--the more seriously injured person may require extended therapies in a structured program that has all the elements found in the acute rehabilitation center. Emphasis will usually be on cognitive and memory retraining, speech therapy, activities of daily living (ADLs), restructuring lost social behaviors, and continuing physical therapy. Prevocational and vocational training, recreational therapy, and community reentry are usually part of each program. Patients will remain in these programs as long as progress is being made--usually 6 to 12 months.
Late rehabilitation--After discharge from the acute rehabilitation center, many people with head injury will need extended rehabilitation either in a residential or inpatient setting or in an outpatient program. Admission requirements may vary and be defined by a specific time after head injury.
Independent living programs (ILPs) are community-based services that assist people with severe disabilities living in their own homes to increase personal self-determination and independence. ILPs provide both direct and indirect services ranging from residential/transitional programs to resource referral.
Life-long residential programs--For those individuals unable to live at home or independently, a residential program may be the only alternative. There are very few programs of this type specifically set up for people with head injuries. Some facilities that have had experience with other disabled populations are beginning to explore this possibility.
The home--For some, the home environment provides the most productive setting for therapy. In addition to in-home nursing care, rehabilitation professionals may come to the client's home on a routine basis to conduct therapy sessions.
TBI social clubs--Although not necessarily a setting for formal rehabilitation, social clubs provide an environment in which people with TBI can associate with each other, form friendships, and instruct each other in how to manage life with a disability.
Therapies discussed here may be provided on an individual basis or in group settings.
Physical therapy comprises treatment designed to restore normal physical function: walking, use of hands, use of arms, and so forth. A physiatrist may specify the course of treatment, integrating physical therapy with other programs.
Therapeutic recreation focuses on resuming leisure activities, community skills, and social skills.
Speech and language therapy--Language disruption is common with TBI and is specifically addressed in speech therapy. Speech therapy encompasses relearning appropriate methods of communication, verbal and nonverbal, as well as relearning communication of abstract thought.
Cognitive therapy offers retraining in the ability to think, use judgment, and make decisions. The focus is on correcting deficits in memory, concentration and attention, perception, learning, planning, sequencing, and judgment. A neuropsychologist, aided by other specialists (for example, occupational therapists [OTs], speech and language pathologists [SLPs]) may be asked to evaluate the level and kind of cognitive dysfunction following TBI, and they may reassess the individual over time to measure recovery.
Occupational therapy offers retraining to enable the person with TBI to cope with the routine demands of a work environment. Often the occupational tasks are at a level below that of preinjury status.
Behavioral therapy involves modification of maladjusted, asocial, or socially inappropriate behaviors.
Psychotherapy targets emotional issues, social adaptation, and self-awareness. Group psychotherapy is useful for feedback, support, and confrontation by peers. Family members may participate in therapy to help them cope with the stress of being a caregiver and to build their ability to provide appropriate in-home support.
Social skills training may be provided as a separate program, or it may be integrated into any of the methods described above.
| Phases of treatment and recovery | ||||
|---|---|---|---|---|
| Scale or measure | Acute | Intensive | Recovery | Survival |
| Intracranial Pressure (ICP) | ||||
| Brain scans (CT, MRI) | ||||
| Duration of coma (DOC) | ||||
| Duration of post traumatic amnesia (PTA) | ||||
| Glasgow Coma Scale (GCS) | ||||
| Galveston Orientation and Amnesia Test (GOAT) | ||||
| Rancho Los Amigos Scale (RLAS) | ||||
| Physical impairment measures | ||||
| Injury Severity Scale (ISS) | ||||
| Bond Neurophysical Scale (BNS) | ||||
| Glasgow Outcome Scale (GOS) | ||||
| Disability Rating Scale (DRS) | ||||
| Functional Independence Measure (FIM) | ||||
| Functional Assessment Measure (FAM) | ||||
| Portland Adaptability Inventory (PAI) | ||||
| Community Integration Questionnaire (CIQ) | ||||
The validation of TBI rehabilitation systems and the study of neurobehavioral outcomes measurement are evolving. Currently there is no consensus on which measures of outcome should be used to assess long-term recovery.
The Glasgow Outcomes Scale (GOS) has commonly been used in the acute care literature to measure outcomes from TBI. It is widely felt to be too simple to be useful as a single indicator of outcome. The GOS (Jennett and Bond, 1975; Jennett, Snoek, Bond, et al., 1981) may be used to rate outcome during any phase of recovery and is often a part of a patient's acute hospital record (Marshall, Bowers-Marshall, Klauber, et al., 1991; Braakman, Gelpke, Habbema, et al., 1980; Narayan, Anderson, et al., 1988). It has five levels: (1) death, (2) persistent vegetative state (absence of cortical function), (3) severe disability (conscious but disabled), (4) moderate disability (disabled but independent), and (5) good recovery (resumption of "normal life"). Many studies group the various levels into poor outcome (GOS 1-3) or good outcome (GOS 4 or 5). The simplicity of the scale does not lend itself to accurate prediction of future performance, particularly for people categorized as moderately disabled (Brooks, Campsie, Symington, et al., 1986).
The Rancho Los Amigos Scale (RLA) (Hagen, 1979) is also used by acute care staff to categorize a patient's status and determine placement at discharge. It consists of eight levels of cognitive functioning: (1) no response, (2) generalized response, (3) localized response, (4) confused-agitated, (5) confused-inappropriate, (6) confused-appropriate, (7) automatic-appropriate, and (8) purposeful-appropriate.
The Functional Independence Measure (FIM) is an 18-item scale that evaluates self-care, sphincter control, mobility, communication, psychosocial Choi, adjustment, and cognitive function (Granger, Hamilton, and Sherwin, 1986). Because it serves as the outcome measure in the Uniform Data System for Medical Rehabilitation, it has been applied by inpatient rehabilitation programs to a large population of patients with diverse problems, including TBI (Guide for the Uniform Data System for Medical Rehabilitation [Adult FIM], 1993; Fiedler and Granger, 1997).
The FIM is considered to be the best single outcome scale for use during inpatient rehabilitation. However, a high score on the FIM does not necessarily mean a return to full function. For example, by FIM scores, about one-quarter of people with TBI are independent at the time of discharge from inpatient rehabilitation, and one-half are independent by 1 year after injury. Followup studies, however, suggest that people with moderate or severe traumatic brain injury are unlikely to return to competitive employment (High, Boake, and Lehmkuhl, 1995).
Attempts to circumvent this "ceiling effect" by adding more cognitive/psycho-social information to the scale (FIM + FAM [functional adaptability measure]) have met with limited success (Hall, Mann, High, et al., 1996). Judging by the FIM or FIM + FAM scores, little progress in recovery is realized after the first year postinjury. However, without evidence of such a plateau in the recovery process, the utility of these scales for long-term followup is in question. This limitation of the FIM (or FIM + FAM) is not surprising, since these indexes were designed to describe progress during rehabilitation and not functional status after discharge. In fact, therapists sometime use the attainment of threshold performance on items that are contained within the FIM as criteria for discharge.
The Disability Rating Scale (DRS) was developed to improve on the GOS as a global disability outcome tool (Rappaport, 1982). Questions on the DRS span the recovery phases, so the instrument can be used beginning in acute care through outpatient rehabilitation to track individual progress. It has been shown to have validity, high reliability, and good utility (Eliason and Topp, 1984; Hall, Cope, and Rappaport, 1985; Fryer and Haffer, 1987; Gouvier, Blanton, LaPorte, et al., 1987). The DRS also has been shown to be a good predictor of employment (Rappaport, Herrero-Backe, Rappaport, et al., 1989; Rao and Kilgore, 1992; Cope, Cole, Hall, et al., 1991) and to interact with measures of severity of injury (Thatcher, Cantor, McAlister, et al., 1991). The DRS appears to have less ceiling effect than the FIM or FIM + FAM (Hall, Mann, High, et al., 1996) but probably is not as useful as the FIM for inpatient assessment.
High scores on functional measures do not necessarily predict a successful return to the community. In response, tools to evaluate reintegration have been developed. The Community Integration Questionnaire (CIQ) is a 15-item survey that evaluates home integration, social integration, and integration into productive activities. The questions are about practical, everyday tasks that are markers of independence, such as shopping, managing finances, meal preparation, and pursuing leisure time activities. Another scale used to evaluate deficits that may impede reintegration is the Portland Adaptability Inventory (PAI) (Lezak, 1987), a set of three scales that measure temperament and emotionality, activities and social behavior, and physical capabilities.
How well do these measures predict what happens after discharge from the rehabilitation unit? One study compared estimated working capacity as evaluated at discharge with actual employment at 6 months followup (N = 147) (McLaughlin and Peters, 1993). As measured by assessment at the time of discharge, 11 percent were classified as unemployed; the actual outcome at 6 months was 39 percent. Other studies (McLaughlin and Peters, 1993; Najenson, Groswasser, Mendelson, et al., 1980; Olver, Ponsford, and Curran, 1996) found that some survivors of TBI regress as a function of their transition from one phase of treatment to the next. These observations suggest that measures taken at the time of discharge from the inpatient unit may not be valid shortly thereafter. Repeating the FIM or other standard measures some time after discharge from the inpatient rehabilitation facility might improve prediction and counteract the "ceiling effect" described earlier.
Because standard measures may fail to predict outcome for a large cross-section of survivors (Sbordone, Liter, and Pettler-Jennings, 1995), many clinics and rehabilitation programs have developed their own instruments for tracking patient progress. These instruments may be useful within their specific milieu, but their use hinders comparisons among centers and among published studies.
Only a few population-based studies have been done to examine the long-term outcomes of individuals who survive traumatic brain injuries (Dawson and Chipman, 1995; Edna and Cappelen, 1987; Pentland and Miller, 1986; van Balen, Mulder, and Keyser, 1996). In a Canadian study of survivors 13 years after injury, 66 percent reported the need for ongoing assistance with some ADLs, 75 percent were not working, and 90 percent reported some limitations or dissatisfaction with their social integration (Dawson and Chipman, 1995). In a study performed in the Netherlands, 67 percent of the population with major TBI had long-term situational, cognitive, and behavioral disabilities, and only 10 percent received any rehabilitation services after the acute-care period (van Balen, Mulder, and Keyser, 1996).
Comparable population-based information from the United States is sparse. In a study of 520 Vietnam War veterans 15 years after surviving penetrating head trauma, 56 percent were employed (Kraft, Schwab, Salazar, et al., 1993; Schwab, Grafman, Salazar, et al., 1993). A registry study, the Traumatic Coma Data Bank, found that two-thirds of survivors who were employed or in school before their injury returned to work within 1 year of injury (Ruff, Marshall, Crouch, et al., 1993). A few small U.S. studies have used acute hospital discharge abstracts to identify patients with TBI. In one of these, one-third of patients were cognitively impaired and 60 percent were unemployed 6 months after discharge. Only 8 of the 48 located at followup received any rehabilitation services (Dombovy and Olek, 1997). In a study of 31 patients identified from discharge records of acute care hospitals and surveyed after 2 years, many people with moderate-to-severe head injuries remained unable to work, support themselves financially, live independently, or participate in preinjury leisure activities (Dikmen, Machamer, and Temkin, 1993).
Rehabilitation programs designed for populations of TBI survivors with all levels of deficit can achieve about 50 percent employment (Ben-Yishay, Silver, Plasetsky, et al., 1987; Prigatano, 1986). The main trends of employment postinjury are summarized by Wehman, Sherron, Kregel, and others (1993) as follows: (a) unemployment rates soar in survivors of TBI postinjury; (b) unemployment stays at very high rates of 50 to 80 percent for long periods of time, even when vocational rehabilitation services are provided; (c) wages are greatly reduced from preinjury levels; and (d) there is high job turnover among survivors postinjury.
Most information about the long-term outcomes of people with traumatic brain injury comes from followup studies of patients who underwent inpatient rehabilitation. While they are useful in understanding what to expect from inpatient rehabilitation in the long run, these studies are of limited usefulness in estimating the long-term burden of TBI in the general population for two reasons.
First, these studies exclude the large numbers of survivors who do not undergo acute inpatient rehabilitation. As noted above, patients with mild or severe injuries who enter inpatient rehabilitation units are not necessarily representative of patients generally.
Second, because survivors of TBI who have a poor outcome are relatively difficult to follow up over time, the studies may overestimate the likelihood of a good outcome. In one study, for example, the investigators vigorously tried to contact 88 people who had TBI 1 year after they were discharged from acute rehabilitation (Corrigan, Bogner, Mysiw, et al., 1997); 34 (38.6 percent) of these individuals could not be reached. People intoxicated at time of injury and those with history of substance abuse were more likely to be lost to followup. The authors noted that, among those who were contacted, these characteristics were associated with a lower probability of return to work. They concluded that "systematic bias in longitudinal studies may result from subjects with substance abuse problems being lost to followup. Population estimates for return to work or school will be overestimated if those lost who have substance use problems resemble those followed" (Corrigan, Bogner, Mysiw, et al., 1997, p. 132).
Fourteen studies concerned long-term outcomes of unselected patients with TBI after acute inpatient rehabilitation (Asikainen, Kaste, and Sarna, 1996; Corrigan, Bogner, Mysiw, et al., 1997; Dombovy and Olek, 1997; Eames, Cotterill, Kneale, et al., 1996; Fearnside, Cook, McDougall, et al., 1993; Greenspan, Wrigley, Kresnow, et al., 1996; Hawkins, Lewis, and Medeiros, 1996; High, Hall, Rosenthal, et al., 1996; Rappaport, Herrero-Backe, Rappaport, et al., 1989; Sander, Kreutzer, Rosenthal, et al., 1996; Spatt, Zebenholzer, and Oder, 1997; Tennant, MacDermott, and Neary, 1995; Whitlock, 1992; Whitlock and Hamilton, 1995). Four studies were multicenter (Greenspan, Wrigley, Kresnow, et al., 1996; Sander, Kreutzer, Rosenthal, et al., 1996; Tennant, MacDermott, and Neary, 1995; Whitlock and Hamilton, 1995). The sample size for eight studies was under 100 and ranged between 181 and 525 for six studies. Followup measures were taken at < 2 years for seven studies and at > 2 years for six studies. In these studies, between 13 percent and 40 percent of subjects could not be reached for followup.
In general, patients show substantial improvements in physical, cognitive, and other functions between the time of admission to a rehabilitation facility and the time of discharge or at long-term followup. At the same time, continued morbidity and disability are common. Eight of the studies addressed postinjury return to productive activity. Postinjury unemployment ranged from 28 percent to 75 percent across these studies (Asikainen, Kaste, and Sarna, 1996; Dombovy and Olek, 1997; Fearnside, Cook, McDougall, et al., 1993; Greenspan, Wrigley, Kresnow, et al., 1996; Hawkins, Lewis, and Medeiros, 1996; Rappaport, Herrero-Backe, Rappaport, et al., 1989; Sander, Kreutzer, Rosenthal, et al., 1996; Spatt, Zebenholzer, and Oder, 1997). Employment in a job below preinjury level or with reduced hours and demand ranged from 7 percent to 34 percent.
Studies differed widely in the methods used to measure return to work. Accounting for differences in measurement and the impact of injury severity on the probability of returning to work, it appears that more than half of survivors of TBI become unemployed as a consequence of their condition. For example, some samples combined survivors who retired with those who were unemployed or placed on disability. Also, some studies did not account for preinjury unemployment. At 1-year followup, one study reported 75 percent unemployment; preinjury unemployment for that sample was 19 percent (Hawkins, Lewis, and Medeiros, 1996). Forty-one individuals had an initial GCS of 3 to 8, suggesting a group with severe impairments, which could account for the high unemployment ratio. The study with the lowest postinjury unemployment ratio retrospectively evaluated 496 survivors up to 20 years after injury (Asikainen, Kaste, and Sarna, 1996). In that sample, 285 (58 percent) had an initial GCS of 3 to 8; postinjury unemployment was 28 percent, with an additional 14 percent working at jobs below the preinjury standard.
Seven studies used long-term followup to assess community reintegration (Eames, Cotterill, Kneale, et al., 1996; Fearnside, Cook, McDougall, et al., 1993; Hawkins, Lewis, and Medeiros, 1996; Rappaport, Herrero-Backe, Rappaport, et al., 1989; Tennant, MacDermott, and Neary, 1995; Whitlock, 1992; Whitlock and Hamilton, 1995). Type of placement at discharge from inpatient rehabilitation is often used as an indicator of community reintegration. It is difficult to compare the results of different studies because the categories for disposition at discharge vary. Also, a postinjury living status of "alone" may indicate a high level of independence and a successful recovery, or it may indicate social isolation and a decrease in quality of life. Thus, postinjury status without a measure of change from preinjury status may not be an accurate indicator of the effect of the trauma.
To estimate the impact of TBI on community integration, we categorized disposition as either discharged to home or to an institution such as a skilled nursing facility, long-term rehabilitation center, hospital, prison, etc. In six studies that measured this outcome, the proportion of people institutionalized after discharge from inpatient rehabilitation ranged from 6 percent to 52 percent (Eames, Cotterill, Kneale, et al., 1996; Fearnside, Cook, McDougall, et al., 1993; Hawkins, Lewis, and Medeiros, 1996; Rappaport, Herrero-Backe, Rappaport, et al., 1989; Whitlock, 1992; Whitlock and Hamilton, 1995).
A study performed in New South Wales, Australia, had the lowest proportion of institutionalized survivors (6 percent) (Fearnside, Cook, McDougall, et al., 1993), perhaps reflecting national cultural differences that would result in a greater number of people being discharged to home rather than to an institution. The highest proportion of institutionalized survivors in these studies was 52 percent (Whitlock, 1992). Of 23 respondents, 11 had returned home, and 12 were in skilled nursing facilities at 1-year followup. Comparing the results of these studies, it appears that institutionalization of roughly half of TBI patients persists beyond 1 year.
Injury severity and preadmission disability affect the probability that a patient will eventually go home as opposed to being institutionalized. In the studies cited above, initial injury severity and preadmission disability were measured by a wide variety of methods, including FIM scores, GCS scores, length of stay in acute care, PTA (post-traumatic amnesia) duration, coma duration, and novel measures designed by the researchers conducting the investigation; each sample contained its own mix of severity levels. Given the inconsistencies in measurement and categorization and differences due to culture and resources, the probability of a patient being in a long-term care facility cannot be estimated from these studies.
One study used the FIM to evaluate outcome at 1 year after discharge from rehabilitation (Hawkins, Lewis, and Medeiros, 1996). As measured by the FIM at 1 year after discharge, 43 of 51 survivors (84 percent) were independent in self care, 42 (82 percent) in locomotion, 27 (53 percent) in communication, and 21 (41 percent) in cognition. In another study (Whitlock, 1992), 20 of 23 patients improved on FIM scores from admission to discharge. However, for this same group, only five patients improved on the GOS between 6 months and 1 year postdischarge. Seventeen stayed the same (one patient was not included in the 1-year assignment). Other studies that used the GOS to estimate functional status present sample proportions with good outcomes ranging from 24 percent to 79 percent (Hawkins, Lewis, and Medeiros, 1996).
A large number of studies have examined the predictive ability of patient characteristics known at the time of admission to inpatient rehabilitation units (Cowen, Meythaler, DeVivo, et al., 1995; Lehmann, Steinbeck, Gobiet, et al., 1996; Malec, Smigielski, De Pompolo, et al., 1993; Saneda and Corrigan, 1992; Spatt, Zebenholzer, and Oder, 1997; Torkelson, Jellinek, Malec, et al., 1983; Vilkki, Ahola, Holst, et al., 1994; Zafonte, Hammond, Mann, et al., 1996). Variables that have been associated with long-term outcomes include:
Preinjury characteristics such as diseases, psychological conditions, and social and economic issues.
Age and sex.
Severity of brain injury (site, severity, mechanism of injury, secondary insults such as hypotension or hypoxia, etc.).
Severity and influence of extracranial injuries and complications of acute-care hospital care.
Length of time between the initial injury and the initiation of rehabilitative treatment.
The Glascow Coma Scale (GCS) score is the instrument most intensively studied (Teasdale and Jennett, 1974). This scale, ranging from 3 to 15 points, reliably and repetitively describes the level of consciousness of the patient with TBI. When it is carefully scored at the completion of resuscitation, the GCS is highly predictive of outcome measured by the Glasgow Outcome Scale (GOS) (Jennett and Bond, 1975) at 3, 6, and 12 months after injury (Braakman, Gelpke, Habbema, et al., 1980; Choi, Narayan, Anderson, et al., 1988; Levin, Gary, Eisenberg, et al., 1990; Marshall, Gautille, Klauber, et al., 1991). However, emergency departments vary in who performs the assessment (neurosurgeon versus emergency department staff) and when it is performed (before or after blood pressure and hypoxia are stabilized) (Marion and Carlier, 1994); these variations can affect the ability of the GCS to predict outcome (Bullock, Chesnut, Clifton, et al., 1998). Attention to these details has been lacking in the literature to date, even in quasiexperimental studies that use the GCS as a covariate.
In addition to the GCS, four other indicators are useful. A recent evidence-based literature analysis done for the World Health Organization as part of the Guidelines for the Management of Severe Head Injury has outlined the operating definitions of these variables and the optimal methods for their collection and has suggested that they be controlled via multivariate analysis in all subsequent TBI outcome prediction studies (Bullock, Chesnut, Clifton, et al., 1998).
The status of the pupils (an indicator of intracranial pressure or herniation) helps predict outcome (Marshall, Gautille, Klauber, et al., 1991).
Age is usually (Jennett, Teasdale, Galbraith, et al., 1979; Vollmer, Torner, Jane, et al., 1991; Waxman, Sundine, and Young, 1991; Braakman, Gelpke, Habbema, et al., 1980; Choi, Narayan, Anderson, et al., 1988) but not always (Reeder, Rosenthal, Lichtenberg, et al., 1996) found to predict GOS and function (FIM) after rehabilitation. Age appears to be a primary predictor independent of age-related factors such as systemic illnesses (Vollmer, Torner, Jane, et al., 1991).
The presence of severe systemic injuries is also correlated with worse outcome (Bowers and Marshall, 1980; Klauber, Marshall, Luerssen, et al., 1989; Mayer, Walker, Shasha, et al., 1981). However, when systemic hypotension occurring during the period between injury and the end of resuscitation is controlled, the influence of systemic trauma drops out (Chesnut, Marshall, Klauber, et al., 1993). This suggests that the influence of injuries to extracranial organ systems on outcomes from TBI is primarily mediated by the associated hypotension.
It would seem logical that the location, extent, and severity of damage to the brain would be predictive of outcome from TBI. Although prediction studies have correlated outcome with various parameters consistent with severity of brain injury such as skull fracture, intracranial hematoma, or presence of surgical mass lesions (Bergman, Rockswold, Haines, et al., 1987; Braakman, Gelpke, Habbema, et al., 1980; Jennett, Teasdale, Galbraith, et al., 1979; Waxman, Sundine, and Young, 1991), no one has yet demonstrated the expected degree of anatomic specificity in predicting recovery or residual deficits. This may be largely a question of defining the extent of brain injury based on the rather limited technology of computed tomography and magnetic resonance imaging. To date, the Traumatic Coma Data Bank classification of the CT imaging of the brain during the acute-care course is the most promising method of incorporating the anatomical nature of the brain injury into a predictive model (Marshall, Bowers-Marshall, Klauber, et al., 1991).
Other variables that have been suggested as predictive of outcome, as measured by GOS, include mechanism of injury (Waxman, Sundine, and Young, 1991), brainstem reflexes (Born, Albert, Hans, et al., 1985), evoked potentials (Anderson, Bundlie, and Rockswold, 1984), cerebrospinal fluid (CSF) catecholamines (Woolf, Hamill, Lee, et al., 1987), degree and severity of intracranial hypertension (Alberico, Ward, Choi, et al., 1987; Jones, Andrews, Midgley, et al., 1994; Marmarou, Anderson, Ward, et al., 1991), jugular venous desaturation (Gopinath, Robertson, Contant, et al., 1994; Jones, Andrews, Midgley, et al., 1994; Robertson, Contant, Gokaslan, et al., 1992), cerebral perfusion pressure (Gopinath, Robertson, Contant, et al., 1994; Jones, Andrews, Midgley, et al., 1994; Robertson, Contant, Gokaslan, et al., 1992), fever (Jones, Andrews, Midgley, et al., 1994), and in-hospital hypotension (Chesnut, Marshall, Piek, et al., 1993; Jones, Andrews, Midgley, et al., 1994). The statistical independence of these various factors remains to be clearly delineated. It cannot be suggested at this time that they be included as potential injury severity confounding variables in rehabilitation studies. When planning such investigations, however, the present state of the literature must be assessed since some of these indexes, or variations thereof, may develop as mandated covariables.
Two other indexes, duration of PTA and coma, are frequently used in quasiexperimental studies to adjust for severity of injury. Both of these are determined at some time following the injury.
The use of PTA originated with Russell and colleagues in the 1930s (Russell, 1932; Russell, 1935; Russell, 1971; Russell and Nathan, 1946; Russell and Smith, 1961). Russell classified injuries with PTA < 5 minutes as very mild; 5 to 60 minutes as mild; 1 to 14 hours as moderate; > 24 hours as severe; > 1 week as very severe; and > 4 weeks as extremely severe. In a study of 1,766 patients, Russell and Smith (1961) found the duration of PTA to be the single best predictor of neurological outcome.
In many studies, PTA is measured retrospectively by reviewing patient charts. Unfortunately, retrospective PTA is unreliable (Gronwall and Wrightson, 1980). PTA is best determined prospectively using as an index the attainment of a criterion score (e.g., 85 percent) on the Galveston Orientation and Amnesia Test (GOAT) (Levin, O'Donnell, and Grossman, 1979).
It is difficult to reconcile PTA with the more commonly used GCS score as an index of TBI severity. Using a PTA of > 24 hours as their criterion for the diagnosis of severe TBI, Bishara and colleagues found that 81 percent of such patients attained a good outcome (GOS 4-5) at 1 year (Bishara, Partridge, Godfrey, et al., 1992). This contrasts with only 43 percent of patients achieving such an outcome in the Traumatic Coma Data Bank (TCDB), where severe head injury was defined as a postresuscitation GCS = 8 (Marshall, Gautille, Klauber, et al., 1991). Such a discrepancy suggests that these two indexes cannot be used interchangeably as they will be predictive of markedly different courses of recovery.
Duration of coma has been used to quantify the severity of brain injury and to predict outcome. Patients in coma for < 20 days frequently regain independence in functional activities, whereas those who remain in coma > 20 days are usually profoundly disabled (Jones, 1981; Pazzaglia, Frank, Frank, et al., 1975). Like the PTA, duration of coma is unreliable when determined retrospectively, and it is not interchangeable with the GCS score. In addition, its determination can be confounded by the use of medications which are commonly administered during treatment of TBI patients.
Average LOS in acute care after TBI has been used as a gross indicator of the "sickness" of the patient during the immediate, posttraumatic period. More recent studies have reported acute care stays ranging from 20 to 60 days (Lehmkulh, Hall, Mann, et al., 1993; Mackay, Bernstein, Chapman, et al., 1992; Sakata, Ostby, and Leung, 1991; Sparadeo and Gill, 1989). Unfortunately, this variable is sensitive to socioeconomic issues, which may be difficult to control when using it as an indicator of trauma severity.
The above considerations reveal that the prediction of outcome based on physiologic indicators of TBI remains in a state of active development. At present, a credible attempt to control for (or match on) severity of illness should include the five best physiologic indicators described above. Older studies frequently do not use these indicators, the importance of which was not clearly established until recently.
Even today, retrospective analyses are hampered by the lack of reliability and absence of the necessary data in patient charts. Properly approaching this problem in the future will require a coordinated effort in data collection beginning at admission and continuing through rehabilitation wherein common definitions are used throughout.
Two panels of experts worked with the research team to identify key questions in the rehabilitation and survivor phases for adults with TBI. The first panel was composed of two physiatrists, a survivor of TBI, the wife of a survivor of TBI, a State vocational rehabilitation counselor, a neuropsychologist, a psychologist, a clinical coordinator of an outpatient TBI rehabilitation program, and a rehabilitation clinical nurse specialist, all from the Portland, OR, area. The second panel was composed of nationally recognized experts in rehabilitation.
The local panel met twice to establish the scope of the literature review, develop a common understanding of the main concepts bearing on questions of effectiveness in rehabilitation, and identify key questions for investigation. Prior to the first local panel meeting, members were sent a document describing the prevalence, incidence, and burden of illness of TBI and a list of treat-ment settings and techniques. At the first meeting, one of the investigators explained the use of a causal pathway diagram (Woolf, Battista, Anderson, et al., 1990) to enumerate causal links and identify key clinical questions about an intervention. Causal pathways highlight the role of intermediate measures of outcomes, which are often used as proxies for health outcomes in clinical studies and in practice. The format of the meetings was semistructured to promote free interaction aimed at identifying issues with respect to TBI rehabilitation among representatives of the various disciplines. Proposed questions and elements of causal pathways were documented and synthesized for review by the national panel.
Prior to the first meeting of the national panel, members were provided the same briefing given the local panel members, along with a summary of material generated from the local panel's meetings. During the national panel meeting, members were asked to consider the proposed questions, add to or delete from the list, and elaborate on the revised list of questions. The research team synthesized this second level of input and distributed draft questions for study to both panels. Panel members submitted revisions to the task order manager, who coordinated input and continued to distribute new iterations of the questions until consensus was reached.
Literature was searched using MEDLINE, CINAHL, HealthSTAR, and PsycINFO. In addition, the Cochrane Collaboration made available a database of about 500 articles on brain and spinal cord injury. Four MEDLINE search strategies were written. A single strategy was designed to seek references regarding the timing and intensity of acute care rehabilitation (questions 1 and 2). Three additional search strings were used to find articles on the remaining questions (3, 4, and 5). The full MEDLINE database was searched for randomized controlled trials; otherwise, MEDLINE was searched from 1976 to 1997. One additional search strategy, designed to capture literature for all five questions, was written for each of the remaining databases used (CINAHL from 1982 to 1997, HealthSTAR from 1995 to 1997, and PsycINFO from 1984 to 1997). The search strings are given in Appendix 2. Finally, we searched the Cochrane database for articles about rehabilitation. We referred to the Current Contents database on a monthly basis between November 1997 and May 1998 to ensure we did not miss new literature that might be relevant.
Articles reviewed and cited
| General review criteria |
|---|
| Question specific review criteria |
| Not traumatic brain injury (e.g., carbon monoxide poisoning) |
| Pediatric |
| Pharmacology study |
| Case study |
| Instrument development |
| Alcohol/drug use |
| Stroke |
| Editorial |
| Acute care |
| Foreign language |
| No data |
| Methods |
| Not rehabilitation |
| Wrong independent variable |
| Wrong dependent variable |
| Review questions | |||||
|---|---|---|---|---|---|
| Article subject | Questions 1 and 2 | Question 3 | Question 4 | Question 5 | All questions |
| Population-based study | 3 | 0 | 1 | 1 | 5 |
| Longitudinal study | 23 | 9 | 17 | 21 | 70 |
| Intervention | 17 | 47 | 27 | 14 | 105 |
| Effectiveness | 11 | 7 | 2 | 3 | 23 |
| Measures | 22 | 15 | 12 | 25 | 74 |
| Predictors | 10 | 4 | 16 | 10 | 40 |
| Followup | 2 | 1 | 9 | 21 | 33 |
| Outcomes | 0 | 0 | 5 | 3 | 8 |
| Totals | 87 | 83 | 89 | 98 | 358 |
Note: Entries in cells show number of articles dealing with each subject for each review question. Articles may address more than one subject or appear in more than one review question.
We designed an instrument to record data abstracted from each eligible article (Appendix 4). The instrument includes items for patient characteristics, interventions, cointerventions, outcomes, study methods, relevance to the specific research questions, and results of the study. The instrument has two components: the first three pages of the instrument apply to all articles specified for inclusion in the study. The remaining pages are individual instruments that apply to one of the five questions. To abstract an article, a reader used the initial abstraction instrument plus one or more of the five question-specific instruments.
Retrieved articles were kept in an electronic database (EndNotes PlusTM). User-defined fields were used to record results of the eligibility screen, review for inclusion, and number of reviews performed. Paper copies of the articles were maintained in a master file. Throughout the literature review process, any articles identified from sources such as bibliographies or reference lists, manual searches of journals not contained in electronic databases, or references recommended by outside parties were added to the electronic databases.
We used a three-level system to rate individual studies:
Class I
Properly designed randomized controlled trials.
Class II
Class II(a): Randomized controlled trials that contain design flaws preventing a specification of Class I. An example of a design flaw is failure to blind raters or lack of followup data.Class II(a): Multicenter or population-based longitudinal (cohort) studies.Class II(b): Controlled trials that were not randomized.Class II(b): Case control studies.Class II(b): Case series with adequate description of the patient population, interventions, and outcomes measured.
Class III
Descriptive studies (uncontrolled case series).Expert opinion.Case reports.Clinical experience.
A well-done, prospective, multicenter or population-based cohort study can provide valuable information that, in some ways, is more representative of results in actual practice than are data from a randomized trial done in a highly selected sample. However, an uncontrolled case series is generally classified as Class III, indicating a low level of confidence for inferences about effectiveness.
Why is a control group needed to make inferences about effectiveness? Information about the long-term natural history of TBI provides too little certainty about the outcome to forgo the use of a control group. If the consequences of brain injury in the absence of rehabilitation could be predicted accurately, a control group would not be needed. Some evidence suggests a natural course of recovery from TBI in both basic and complex functions (Dikmen, Reitan, and Temkin, 1983), especially in the first 6 months after injury (Bond, 1979; Levin, Benton, and Grossman, 1982; Levin, Gary, Eisenberg, et al., 1990). After 6 months, survivors of TBI recognize their disabilities as they stabilize and often maximize their functional status, but major deficits in social and leisure activities tend to persist (Oddy and Humphrey, 1980).
A "gray zone" exists between Class II and definite Class III articles. Much of the research in rehabilitation uses quasiexperimental designs. In these observational study designs, control groups are sometimes identified from a separate population of people with TBI. One study compared patients undergoing inpatient rehabilitation with a sample of people with TBI who had been treated in a region of the country where formal inpatient TBI rehabilitation was not available (Aronow, 1987). This was an entirely separate patient group, and all the data except outcome measures came from an independent database.
The main difficulty with the quasi-experimental design is lack of control over the constitution of the compared groups. Since there is no randomization and generally no control over the details of the selection process through which the study participants received their separate therapies, the groups are likely to differ in the frequency of characteristics that are associated with the outcomes of interest. Even when significant efforts are made to match the experimental and the quasicontrol groups, groups still are likely to differ significantly.
Quasiexperimental designs rely heavily on multivariate statistical analysis and matching to counter this problem. While this is common practice, making inferences about effectiveness from statistically controlled data is controversial because these methods do not necessarily guarantee that the results are reliable or that serious bias and confounding have been eliminated. There are at least three major barriers to accuracy in the practice of statistical adjustment for risks. First, all of the confounding variables must be recognized and be associated with accurate and reliable measurement instruments. Second, data on all of these confounding variables must be available in comparable formats in the compared groups. For example, in the study mentioned earlier, baseline data, such as admission functional status scores, may be available for patients who entered inpatient rehabilitation but missing for patients who did not. Third, statistical methods must be selected and applied properly.
Since the first two barriers are virtually never overcome and the third remains somewhat controversial, the execution of a statistically valid quasiexperimental study is a daunting and generally unrealized task. Most studies using retrospective data suffer from the absence of well-measured data on a number of important confounding variables. The few prospective studies generally suffer from a lack of consensus on the proper measurement instruments for many of these variables. Finally, while the standard of practice for use of statistical methods to remove confounding is not completely defined, many studies do not use, or fail to report, available methods to improve the reliability and robustness of these methods.
Much of the literature relevant to the five questions addressed in this report falls into the "gray zone" between Class II and Class III. For this reason, critical appraisal of key studies plays a particularly important role in this review. A number of characteristics of these studies were considered relevant to all rehabilitation questions and were recorded in the data abstraction form. Evaluation of the following factors played a major role in critically appraising these articles:
Prospective collection of data.
Complete description of parent patient population.
Large study population size (driven by hypothesis, power, type I error threshold).
Study setting--a single center, many centers, or population-based.
Descriptions of reasons for referral to service being studied.
Methods described completely enough to allow study replication.
Complete description of rehabilitation technique in question (independent variable).
Complete and adequate description of differences between "control" and "experimental" groups.
Conditions determining whether study subjects did or did not receive the rehabilitation technique in question.
Information about potential confounders, including types and severity of injury; age; and others (including, in some cases, economic status, educational level, lack of family support).
Measurement of confounding variables using instruments validated as accurate, sensitive, and reliable.
Payer group.
Choice of outcome variables that are meaningful to survivors as well as caregivers.
Use of functional status and other health outcomes rather than surrogate intermediate outcomes.
Measurement of outcome variables using instruments validated as accurate, sensitive, and reliable.
Timing of outcome measurements.
Assessment of survivor characteristics and outcomes by blinded observer.
Use of multivariate statistical analysis: Were interactions sought and controlled for? Were risk estimates calibrated? Were all relevant confounders included as candidate variables?
The criteria used to classify articles and the features to be considered in critically appraising them were discussed at the subcommittee, committee, national expert panel, and Aspen Neurobehavioral Conference levels with the goal of maintaining consensus on at least the relative stratification of individual articles.
Evidence tables were constructed to summarize the best evidence about effectiveness pertaining to each question. For questions 1 and 2, there were no randomized trials and only a few quasiexperimental studies. There were many relevant observational studies of important relationships (for example, the relation of survivor characteristics to outcome); while we discuss these results, we chose not to summarize studies that concerned individual causal links or relationships in evidence tables. For question 3, addressing cognitive rehabilitation, 15 randomized controlled trials and comparative studies that met specified inclusion criteria (see the section on question 3) were placed into evidence tables. All comparative studies located for the last two questions, which addressed supported employment and care coordination, were included in evidence tables.
For each of the five questions, we formed subcommittees of one to two members of the research team and one to two members of the local technical panel. A member of the research team chaired each subcommittee. The principal investigator also led subcommittees consisting of members of the national expert panel. All members of the subcommittees reviewed key articles relevant to the assigned question. These reviews were discussed among the various members of the subcommittees, and the results were summarized by the chair. This was an attempt to ensure that the summary statements on the research questions reflected the expertise and experience of a variety of technical experts with relevant skills and training. These interpretive efforts addressed the methods and results of individual studies, their ratings, and their scientific importance.
The principal investigator read all of the critical articles for the five questions. Summaries were presented and discussed with national experts at the Aspen Neurobehavioral Conference in April 1998 (see Appendix 6).
The results are presented in five sections, one for each of the questions listed in Appendix 1. When necessary, we provide additional information about background and methodology before the discussion of results for each section.
It is widely accepted that patients with severe head injury should undergo a course of inpatient rehabilitation immediately after discharge from the acute care hospital. A retrospective study demonstrated that patients admitted to rehabilitation units less than 35 days after injury required less rehabilitation to achieve the same functional level as those admitted more than 35 days after injury (Cope and Hall, 1982). This study raised the question of whether interdisciplinary rehabilitation should be started earlier than was customary.
Early neurological rehabilitation means starting rehabilitation of brain damaged patients as soon as possible during the acute phase of the trauma or illness, often while the patient is still unconscious. The components of early rehabilitation might include a multidisciplinary family conference and a baseline assessment by a physiatrist, occupational therapist, physical therapist, and when the patient is conscious or has a tracheotomy, a speech therapist (Sherburne, 1986).
Note: FIM=Functional Independence Measure
GOS=Glasgow Outcome Scale
The remaining arcs represent indirect evidence. On the left of the figure, the first link in the causal chain is that early rehabilitation might reduce the total length of stay for the acute admission and rehabilitation combined (arc 4). The next link is that a shorter length of stay would reduce the total costs of care (arc 7). On the right, the first link is that patients who undergo early rehabilitation will be discharged to the inpatient rehabilitation service in better condition than those who receive usual care (arc 5). The next link is that, as a result, scores on functional assessment instruments at the end of rehabilitation will be the same or better as in usual care, despite the shorter length of stay (arc 6). An implicit assumption, indicated by arc 8 in the figure, is that better scores on these assessments translates into better health outcomes after discharge from the rehabilitation unit.
Although such evidence cannot ever be as strong as evidence from a well-conducted experimental trial, certain methods of study design or analysis can improve the reliability of the findings. First, the baseline characteristics of the patients in the compared groups should be described in detail using reliable measures of severity, comorbidity, and other information that might be associated with the outcome of interest. At a minimum, these measures are age, GCS scores, and indicators of severity and mechanism of injury, multiple injuries, and preinjury function. Second, matching, stratification, or statistical adjustment for these risk factors should be used to minimize the influence of confounders on the study's observed results. We used these study characteristics as inclusion criteria to identify high-quality studies of the relations depicted in the causal pathway. Third, the study must report at least one relevant outcome measure, such as:
Presence or absence of complications.
Length of stay in the hospital.
Costs of immediate care and long-term financial burden.
Health status at discharge from the acute care hospital.
Long-term measure of impairment.
Long-term measure of disability.
Of the 87 articles that passed the eligibility screen and were assigned to Questions 1 and 2, 14 were potentially relevant to the timing of intensive rehabilitation. Of these, two were review articles (Cope, 1995; Jorgensen, 1997), three were studies that contained no original data (Johnson and Roethig-Johnson, 1989; Kock and Fuhrmann, 1992; Kosubek, Feldmann, and Schwendemann, 1996), and one was a case report (Sherburne, 1986). The eight remaining articles are discussed below.
There is no direct evidence from randomized trials about the effect of early neurological rehabilitation on health outcomes.
No prospective, randomized controlled trials of the effects of early rehabilitation on length of stay, condition at the time of entry into a rehabilitation unit, or long-term costs have been done. Moreover, no nonrandomized (observational) controlled study fully met the criteria described above.
This program was initiated very early at the formalized rehabilitation hospital, uniformly beginning while patients were in coma an average of 2 days after admission. At the 10 nonformalized acute rehabilitation hospitals, therapy was started during coma in 42 percent of patients, an average of 23 days after admission. For the nonformalized group, 14 percent received only physical therapy, 65 percent did not receive speech therapy, and 14 percent did not receive any rehabilitation.
Severity of injury was rated using GCS score, injury severity score (ISS), RLA score, pupillary and pain responses, CT scans, associated injuries, and surgical interventions. The main outcome variables were LOS at the trauma and rehabilitation hospitals and condition on discharge from the rehabilitation unit (length of coma, RLA at discharge from acute care and rehabilitation).
The authors found that the patients in the formalized treatment group had coma durations and rehabilitation stays about one-third the length of patients in the nonformalized group. There was no difference in acute hospital LOS. The acute LOS ranged from 50 to 60 days. The rehabilitation LOS was 106 days for the formal system and 239 days for the nonformal system, giving rather long total mean LOS of 158 days and 303 days, respectively. Physical/motor, sensory/perceptual, and cognitive/language outcomes were better for the formalized group. These were scored using a specified but nonstandardized rating system. The differences in length of coma, rehabilitation LOS, total LOS, and RLA at discharge from the acute hospital remained large and statistically significant after statistical adjustment for the initial GCS and RLA scores.
Is it plausible that providing comprehensive rehabilitation during coma could reduce the average length of coma by 35 days? The patients in the compared groups were similar in age, associated injuries and initial GCS, ISS, and RLA scores. However, other predictors of a long length of stay in rehabilitation, such as more detailed head CT findings (Cowen, Meythaler, DeVivo, et al., 1995), extremity fracture, and FIM scores (High, Hall, Rosenthal, et al., 1996), were not recorded. As others have pointed out (High, Boake, and Lehmkuhl, 1995), the sample consisted of 38 patients recruited over 6 years, and it is not clear whether they were representative of patients with severe head trauma generally.
A major weakness of the paper is that the results are reported only as means for the compared groups, making it impossible to determine how many patients in the formal early rehabilitation benefitted. Because of the small sample size, it is possible that the very large difference in length of stay reflects the influence of one or more outliers in the group who did not receive formal early rehabilitation. Moreover, no information is provided about the reasons for the longer LOS in this group, so the mechanism by which early rehabilitation might have affected rehabilitation LOS is not clear.
A number of studies have examined whether early initiation of rehabilitation during the acute hospitalization for TBI is associated with a shorter rehabilitation LOS. The evidence presented in these studies is indirect because early transfer to a rehabilitation unit is not the same, or even necessarily similar, to initiating rehabilitation in the days immediately following postinjury stabilization.
As mentioned earlier, Cope and Hall (1982) retrospectively analyzed the influence of early rehabilitation on hospital LOS and costs. They arbitrarily defined the threshold dividing early and late rehabilitation as 35 days based on the median interval between injury and admission for their overall patient group. They matched two groups of patients (16 early and 20 late patients) for length of coma and analyzed other variables between groups including age, acute GCS (assigned retrospectively), DRS and GOS at entry to rehabilitation, evoked potentials, continence, social status, and physiological impairment (rated on an unspecified set of tests). None of these differences were statistically significant by t-statistics, but the researchers did not use multivariate analysis.
Acute hospitalization days, acute-rehabilitation days, and total hospital days were all greater in number, reaching statistical significance, in the delayed-rehabilitation group. Total hospital stay was over twice as long. Of interest, when the researchers looked at outcome measures at the time of discharge, both the DRS and the GOS appeared similar, suggesting that the patients reached a comparable level of recovery at the time of discharge.
As the authors noted, the most important limitation of this study is that the ability to match the compared groups is very limited. It seems likely that rehabilitation was started earlier in some patients because they were doing better to begin with. In addition, as in the Mackay, Bernstein, Chapman, et al. (1992) study, only mean LOS was reported, so it is possible that a few outliers were responsible for the large differences observed. In general, most patients who have a shorter acute hospital LOS go home, while those who have a longer LOS are more likely to enter a rehabilitation unit (Andersen, Sharkey, Schwartz, et al., 1992). This raises a question of a potential bias (the "Will Rogers phenomenon") that, among patients who have similar admission GCS scores, those who are discharged early are likely to be healthier than those who are not.
Five studies have used multivariate analysis methods to identify factors associated with a long rehabilitation LOS (Andersen, Sharkey, Schwartz, et al., 1992; Cowen, Meythaler, DeVivo, et al., 1995; High, Hall, Rosenthal, et al., 1996; Rappaport, Herrero-Backe, Rappaport, et al., 1989; Spettell, Ellis, Ross, et al., 1991). Four of these studies found an association between early initiation of rehabilitation and a shorter rehabilitation LOS. In one study of 59 patients with severe injuries from a single rehabilitation facility, sex, GCS motor score, and acute LOS provided the best prediction of rehabilitation LOS, accounting for 34 percent of the total variance in a stepwise regression model (Spettell, Ellis, Ross, et al., 1991). After controlling for acute LOS, duration of coma was no longer an independent predictor of rehabilitation LOS. A study of 91 patients admitted to a single university inpatient rehabilitation center had similar findings (Cowen, Meythaler, DeVivo, et al., 1995). In that study--which included patients with mild, moderate, and severe injuries--admission FIM motor score and the length of the acute hospitalization were the strongest predictors of rehabilitation LOS.
A larger, prospective study of 525 patients in the TBI Model Systems sample confirmed some of these findings. The study by High, Hall, Rosenthal, et al. (1996) examined the association between initial severity of TBI, rehabilitation admission FIM, neurologic and extracranial medical complications, mechanism of injury, and payer source in predicting hospital LOS and charges. Patients' initial presentations ranged from mild to extremely severe and were generally skewed toward the severe end of the scale. Patients with lower GCS scores reached rehabilitation later, stayed longer, and generated higher charges than less severely injured patients. For patients within a given TBI severity, rehabilitation LOS and costs increased as acute hospitalization LOS and rehabilitation admission FIM increased. The effect of the admission FIM score was a very powerful predictor of rehabilitation LOS. For example, patients who had a GCS of 8 or less and an average FIM score 2.5 had an average rehabilitation LOS of 70 days, while patients who had a GCS of 8 or less and an average FIM score 4.5 had an average LOS of 21 days. In a regression analysis, acute care LOS was an independent predictor of rehabilitation LOS, along with GCS, average admission FIM, duration of coma, and medical complications. Together, these variables explained 50 percent of the variance in rehabilitation LOS. However, because the portion of explanatory power attributable to acute care LOS was not reported, it is not clear how strongly these results support the view that acute care LOS is a major determinant of rehabilitation LOS.
In this study (High, Hall, Rosenthal, et al., 1996), age did not correlate with rehabilitation LOS and was not included in the regression models. However, another study performed in the same group of patients found that older patients had much longer rehabilitation LOS than younger patients (89 days versus 55 days), even though acute LOS was not significantly different in the two groups (Cifu, Kreutzer, Marwitz, et al., 1996). These observations suggest that the relation between acute LOS, admission functional status, GCS scores, age, and other factors are complex. As a result, the relation between acute LOS and rehabilitation LOS may apply only within certain subgroups of patients. As mentioned earlier, the complexity of these relationships makes it difficult to interpret the results of Mackay and colleagues' (Mackay, Bernstein, Chapman, et al., 1992) observational comparative study. For example, inclusion of only a few severely injured, older patients with a low admission average FIM could substantially skew the results in one of the compared groups.
No studies have examined the relationship between acute hospital LOS and the long-term costs of rehabilitation. In two of the studies discussed above (Cowen, Meythaler, DeVivo, et al., 1995; High, Hall, Rosenthal, et al., 1996), longer acute care LOS was associated with higher inpatient rehabilitation charges, but these studies did not examine direct costs or costs of care after discharge from the rehabilitation unit.
Only a few studies have examined the association between acute hospital LOS and short- or long-term outcomes of rehabilitation. Two of the studies discussed above addressed whether an acute hospital LOS predicts short- or long-term outcomes of rehabilitation. In one study, after adjustment for other risk factors, a longer acute hospital length of stay was mildly associated with a lower GOS score within 11 months of injury (Spettell, Ellis, Ross, et al., 1991). This association was statistically significant, but it was too small to be considered clinically important. In the other study (Cowen, Meythaler, DeVivo, et al., 1995), a longer acute hospitalization was associated with lower FIM motor and cognitive scores at the time of admission to rehabilitation. A longer acute hospitalization and a lower admission FIM motor score were also associated with lower discharge FIM scores.
Hospital bed days in the acute trauma hospital are frequently used by patients waiting for transfer to an appropriate rehabilitation or chronic care facility (Andersen, Sharkey, Schwartz, et al., 1992). Apart from its effect on LOS and condition on admission or discharge from a rehabilitation unit, early involvement of a physiatrist as part of the acute-care trauma team might have other benefits. In theory, early involvement by a physiatrist could improve the process of initiating and supervising the application of rehabilitation techniques as the indications arise for such interventions. As mentioned earlier, in a large, regional, retrospective study, patients seen by a physiatrist in the acute-care setting were much more likely to be provided postacute rehabilitation than patients whose discharge planning team did not include a physiatrist (Wrigley, Yoels, Webb, et al., 1994). While it is not known whether this influence has a positive effect on outcome, it does suggest that formalized early neurological rehabilitation in the acute care setting might have the benefit of optimizing rehabilitative care after discharge.
One small, retrospective, observational study from a single rehabilitation facility supports an association between the acute institution of formalized, multidisciplinary, physiatrist-driven TBI rehabilitation and decreased length of stay (acute hospital and acute rehabilitation) and some measures of short-term physiologic (noncognitive) patient outcomes (MacKay, Bernstein, Chapman, et al., 1992). The level of evidence is Class III. This study concerned patients with severe brain injury (GCS 3-8); there is no evidence from comparative studies for or against early rehabilitation in patients with mild or moderate injury.
Some indirect evidence also confirms that early rehabilitation is associated with a shorter inpatient rehabilitation LOS, but this association rests on important assumptions that have not been examined in prospective studies. Most important, the association of acute LOS with rehabilitation LOS and greater rehabilitation costs does not directly imply that shortening acute LOS will result in favorable changes in these outcomes. A common confounding variable in the studies reviewed in this section is the inability to control for the possible correlation between the velocity of recovery and the acute hospital LOS. Patients with TBI who have similar GCS scores on admission may recover at markedly different rates. If a patient evidencing rapid recovery reaches threshold for rehabilitation admission and continues to recover quickly thereafter, his or her acute rehabilitation LOS and total LOS days will be fewer than someone who reaches the same landmark at a slower rate. Because present indicators of TBI severity do not measure rate of recovery, this oversight might explain why the relation between acute LOS and rehabilitation LOS persists even after statistical control for severity of illness on admission.
Another finding in the studies reviewed in this section is that rehabilitation admission FIM and acute care LOS are strongly associated with rehabilitation LOS and outcome. This finding suggests that acute hospitalization LOS is not simply a proxy for injury severity or level of recovery on transfer to rehabilitation.
In essence, this question addresses the efficacy of starting formal rehabilitation efforts very early during the acute-care stay at the trauma center as opposed to "filling in" until the patient is transferred to a rehabilitation program. Certain therapeutic modalities such as physical therapy are generally felt to be properly started soon after admission because of the known rapidity with which complications such as contractures begin. Although the details of the proper techniques, timing, and intensity of such treatment remain to be determined, it is unlikely that a control group of patients that would receive no acute physical therapy could be ethically formed. Although the indications for early application of other rehabilitation-oriented therapeutic modalities are less clear, similar ethical constraints will likely prevent the development of pure control groups for any specific discipline.
The ability to study the efficacy of a formalized program, however, is not subject to such constraints at the present time. The concept of the acute initiation of formal rehabilitation should be defined as an attempt to begin rehabilitation independently of the patient's location or other extraneous constraints such as medical complications, bed availability, and so forth. Such a formalized system is an attempt to "blur the line" between the stay at the trauma center and the time at a rehabilitation center. It would attempt to divorce the treatment from the milieu so that the patient's needs would drive the treatment.
As such, the integration of such a formalized program into an acute care center's operating procedures could be effected in a prospectively randomized fashion without ethical constraints. Since such rehabilitation efforts properly come under the aegis of a physiatrist, the primary independent variable would be the involvement of a physiatrist overseeing explicit formalized application of rehabilitation techniques to the "experimental" group as compared with continuation of the status quo in the "control group." The dependent variables would be acute care and rehabilitation LOS, outcome at time of discharge from acute care (admission to inpatient rehabilitation), outcome at discharge from rehabilitation, and cost-effectiveness of resource utilization.
For such an investigation to work, patients would have to be classified into working categories at a very early stage so that formalized and standardized rehabilitation protocols designed to meet their needs could be applied. If every patient were to be treated differently, it would not be possible to control for the resulting confounding of treatment variables with the independent variable. On the other hand, since different patients need a different array of therapeutic modalities (differing in terms of treatments, timing, and intensity), managing all patients in the same fashion would not be proper. Therefore, if the research is to be useful, such issues must be addressed prior to onset of the investigation.
It also would be necessary to strictly define the applied therapies, since these would be confounding variables in the analysis. Issues such as timing, intensity, modalities, therapist training, milieu, and so forth would have to be standardized within and between treatment groups. This will be especially critical if multiple centers are to be included in the study and combined in the data analysis.
Such a study would not address which modalities should be applied at what point during the acute care stage. These are separate questions addressing the efficacy of rehabilitation modalities in general. The suggested investigation would, however, address the present, seemingly artificial dependence of the initiation of formal rehabilitation on extraneous variables which commonly occur during the early postinjury period.
After discharge from an acute care hospital, many people with TBI are admitted to an inpatient facility for intense multidisciplinary rehabilitation. It is widely acknowledged that the evidence supporting the effectiveness of inpatient rehabilitation is weak. A recent review identified eight studies published between 1984 and 1994 on the benefits of inpatient rehabilitation immediately or soon after discharge from an acute care facility (not including studies of "early" rehabilitation discussed in the preceding section) (Hall and Cope, 1995). Of the eight studies, three had control groups (Aronow, 1987; Hall, Mann, High, et al., 1996; Morgan, 1988). Only one study (Aronow, 1987) used a control group that did not undergo inpatient rehabilitation. Two studies (Blackerby, 1990; McLaughlin and Peters, 1993) compared patients who underwent inpatient rehabilitation with those who underwent inpatient rehabilitation plus an additional intervention. Of the four uncontrolled studies (Blackerby, 1990; Heinemann, Sahgal, Cichowski, et al., 1990; McLaughlin and Peters, 1993; Spivack, Spettell, Ellis, et al., 1992), two (Heinemann, Sahgal, Cichowski, et al., 1990; McLaughlin and Peters, 1993) compared measures of patients' function before and after rehabilitation, and two (Blackerby, 1990; Spivack, Spettell, Ellis, et al., 1992) examined the relationship between the intensity of rehabilitation services and outcomes.
A large number of older uncontrolled case series demonstrate that patients who participate in a comprehensive, multidisciplinary rehabilitation program after TBI improve on a variety of measures, including independence in ADLs (Cope and Hall, 1982), language skills (Basso, Capitano, and Vignolo, 1979; David, Enderby, and Bainton, 1982; Lomas and Kertesz, 1978; Sarno, 1976), vocational functioning (Dresser, Meirowsky, Weiss, et al., 1973), and neuropsychological functioning and emotional adjustment (Pazzaglia, Frank, Frank, et al., 1975). The methodologic limitations of these studies have been reviewed elsewhere (High, Boake, Lehmkuhl, et al., 1995).
Do these observational studies provide sufficient evidence that inpatient rehabilitation is an effective intervention? Because they are uncontrolled, these studies cannot prove that the improvements observed would not have occurred anyway in the natural course of recovery from injury. Older series of untreated survivors of TBI strongly suggest that avoidable complications occur frequently among candidates for rehabilitation who are not admitted to an inpatient rehabilitation unit following discharge from an acute care hospital. A study performed in 1969, for example, followed 102 people with TBI whose average length of coma was 3 weeks and whose entry into rehabilitation was delayed an average of 20 months postinjury (Rusk, Block, and Lowman, 1969). These individuals exhibited 30 frozen shoulders, 40 major decubitus ulcers, and approximately 200 other major joint deformities. Rehabilitation efforts in these patients produced significant reversals of these deficits. As the authors argued, however, it is likely that these complications could have been prevented by appropriate admission to a rehabilitation unit following discharge from the hospital.
While it is widely accepted that "doing nothing" is neither a reasonable nor ethical option, many questions remain about the effectiveness and cost of inpatient rehabilitation. How does inpatient rehabilitation compare with modern alternatives, such as outpatient rehabilitation or rehabilitation in a skilled nursing facility? Which components of multidisciplinary rehabilitation are actually responsible for the observed effects? What are the characteristics of the patients who have better results with the application of intensive, interdisciplinary rehabilitation? Does the intensity of rehabilitation services affect long-term outcomes? When should a course of inpatient rehabilitation end?
A precise knowledge of the natural, untreated prognosis of brain injury could reduce uncertainty about the effectiveness of inpatient rehabilitation, but such knowledge is lacking. Because experimental trials of inpatient rehabilitation are unlikely to be performed, investigators have relied on statistical methods to adjust for differences in the baseline characteristics between the groups of patients compared in studies. These groups might be patients who received different intensities of rehabilitation services, received rehabilitation services relatively early or late, or did not receive rehabilitation in the usual course of care. The validity of these methods depends in large part on the predictive ability of the risk factors measured in these studies.
As discussed below, the likelihood of a good outcome depends on many patient characteristics. For this reason, it is impossible to interpret studies that fail to describe the baseline characteristics of the sample under study. In such studies, it is not clear whether the results were due to the interventions under study or to unreported selection factors. Two extremes characterize these studies with respect to the description of populations and samples. On one hand, it is common to have a sample described as "patients who were considered ready for (the intervention) by their occupational therapists" or "consecutive referrals to a vocational rehabilitation program who were considered employable under the right circumstances." On the other hand, the inclusion criteria for the sample may be a lengthy list of narrow parameters, including scores falling within a specific range on a series of neuropsychological tests. In one case, there may be no description of the patients. In the other, the description may be so specific that the results do not apply to the greater proportion of patients.
The nature of rehabilitation makes it difficult to evaluate its effectiveness. Multidisciplinary rehabilitation is a complex intervention. Even in studies that provide evidence that patients undergoing rehabilitation improved, it usually is not possible to determine which specific components of rehabilitation are effective. In general, little description of the precise components of multidisciplinary rehabilitation programs is available. Some studies use the number of hours of performance of individual treatment modalities (e.g., physical therapy, occupational therapy, speech therapy, etc.) as a measure of the intensity of rehabilitation. However, additional hours of specific treatments may be provided to patients who enter rehabilitation with more severe deficits. In addition, their control for the confounding variables that they collected would have been considerably strengthened by the use of multivariate statistical methods such as regression analysis. Even without this confounding, an aggregate measure like time spent with the patient cannot capture the social factors and relationships that can be important components of the therapeutic process.
At present there is no reliable method to measure the effect of exposure to the milieu of the rehabilitation program--the interactions between patients and other patients, nurses, therapists, and physiatrists during the course of an inpatient TBI rehabilitation stay--or to separate their effects from the content of the actual therapy provided. Such information may be critical when attempting to determine whether an inpatient rehabilitation unit or a skilled nursing facility may be interchangeable for a given patient.
Most studies do not provide even descriptive information about the components of rehabilitation and the content of specific interventions. In these studies, rehabilitation is somewhat of a black box--it is defined, by default, as whatever happens between admission to and discharge from a rehabilitation unit. The lack of detail about what constitutes rehabilitation reduces the generalizability of each study's findings and makes it difficult to compare the results of different studies attempting to assess the effectiveness of rehabilitation.
In formulating a strategy for reviewing the literature, we focused on whether information was available to examine the actual mechanisms by which inpatient TBI rehabilitation affects outcomes. Specifically, we sought to examine whether the results of rehabilitation vary according to (1) whether the intervention was directed and managed by a physiatrist and (2) the number, kinds, and frequency of methods applied. Secondarily, we sought to examine which factors predict a good outcome and how these factors may be used in decisions about how and when patients might benefit from inpatient rehabilitation.
The population for this question consists of people who sustained TBI between the ages of 18 and 65 years whose injury severity warranted a trip to a hospital emergency department, transfer to acute care, and subsequent transfer to inpatient rehabilitation. We also intended to focus predominantly on studies that included or measured the following patient characteristics:
Age.
Glasgow Coma Scale score.
Severity of injury.
Multiple injuries.
Premorbid data.
Mechanism of injury (kind of trauma).
Intracranial diagnosis.
Functional status.
Finally, studies had to report one or more of the following outcome measures:
Length of stay in a rehabilitation facility.
Immediate care costs and long-term financial burden.
Health status at discharge from inpatient rehabilitation.
Long-term measure of impairment.
Long-term measure of disability.
Independence, relationships, family life, satisfaction.
Before addressing whether the intensity of inpatient TBI rehabilitation is associated with improved outcome, we examined the more general question of the effectiveness of TBI rehabilitation itself. A large number of uncontrolled case series show that people with brain injuries generally improve by the time of discharge from the acute inpatient rehabilitation facility (Ashley, Persel, and Krych, 1993; Basso, Capitani, and Vignolo, 1979; Ben-Yishay, Silver, Piasetsky, et al., 1987; Cope, Cole, Hall, et al., 1991; Cope and Hall, 1982; David, Enderby, and Bainton, 1982; Dresser, Meirwosky, Weiss, et al., 1973; Eames and Wood, 1985; Evans and Ruff, 1992; Johnston, 1991; Jones and Evans, 1992; Lomas and Kertesz, 1978; Malec, Smigielski, DePompolo, et al., 1993; 1Mills, Nesbeda, Katz, et al., 1992; Panikoff, 1983; Pazzaglia, Frank, Frank, et al., 1975; Prigatano, Fordyce, Zeiner, et al., 1984; Sarno, 1976; Scherzer, 1986; Tuel, Presty, Meythaler, et al., 1992). Because of imperfect knowledge about the natural history of TBI and the nearly complete absence of data about the results of alternative methods of rehabilitation after discharge from the acute care hospital, these Class III studies provide only weak evidence that inpatient rehabilitation is effective. Comparing these studies and aggregating their results into a systematic examination of results was not possible because data were too incomplete to discern the relationship between types of populations or interventions and outcomes.
One quasiexperimental study used an unmatched control group to assess the effectiveness of acute inpatient TBI rehabilitation (Aronow, 1987). Sixty-eight patients were selected from 107 consecutively discharged patients treated at a single inpatient brain injury rehabilitation center. Their long-term outcomes were compared with those of 61 patients selected from 1,400 cases consecutively entered into an epidemiologic database of TBI inpatients at a neurosurgical unit in an area of the country with no comprehensive rehabilitation available for severe TBI. These two groups were termed "rehabilitation" and "nonrehabilitation," respectively. The selection criteria were TBI (> 1 hour of unconsciousness and > 24 hours of altered consciousness), age at injury between 5 and 80, acute hospital LOS > 15 days, and not comatose at the time of acute hospital discharge.
Measures of TBI severity in the Aronow (1987) study were PTA, acute hospital LOS, presence or absence of open brain injury, and number of skull fractures. Age, sex, race, and years postinjury were measured as confounding variables. TBI severity and the other potentially confounding variables were controlled for by using regression analysis, entering the confounding factors into the model prior to adding the rehabilitation versus no rehabilitation variable. The outcome measure was a 13-variable measure that included vocational status; living arrangement; number of recent inpatient treatment episodes; number of recent outpatient episodes; hours of daytime care required; functional status in self-care, mobility, and residential skills; number of home and outside social contacts; and number of physical, cognitive, and emotional symptoms. This standardized outcome measurement was developed unique to this study and has not been otherwise tested. Outcome data were obtained via telephone interview with the person with TBI or a caregiver/relative during a set study period not indexed to time after injury or rehabilitation. Chi square analysis was used to examine differences in PTA between groups, and linear multiple regression modeling was used to control for confounding variables in determining the relationship between rehabilitation and outcome.
At baseline, the rehabilitation and nonrehabilitation groups differed significantly in PTA, the major index of TBI severity used in the study (Aronow, 1987). Seventy percent of the rehabilitation group had PTAs > 4 months, while 74 percent of the nonrehabilitation group had PTAs 1 month. The nonrehabilitation group also was less impaired in self-care activities and memory.
In a multiple regression model adjusting for age, sex, race, injury severity (PTA, acute hospital LOS, open brain injury, number of skull fractures), and years postinjury, rehabilitation was associated with a better long-term outcome (Aronow, 1987). The overall R2 value was 0.551, suggesting that about one-half of the variance in this group was accounted for by the nine predictors plus rehabilitation. Days in acute hospital, duration of posttraumatic amnesia, age at onset, sex, and whether rehabilitation was performed were statistically significant predictors of outcome. However, the correlation coefficient (Pearson r) for rehabilitation was only 0.159, suggesting that only about 3 percent of the variance was related to whether or not rehabilitation was done.
This study (Aronow, 1987) mildly supports the hypothesis that acute inpatient TBI rehabilitation improves outcome. The finding of a benefit despite worse initial severity in the rehabilitation group lends some credence to the results. The study has important weaknesses that have been enumerated by others (High, Boake, and Lehmkuhl, 1995). The obvious baseline differences between the two groups means that the attempt to identify a suitably comparable control population failed. While the statistical analysis was well done, this method of control works best when there is good reason to believe that the two groups being compared are similar. The differences also reflect the underlying problem that the subset of patients admitted to a rehabilitation unit are not representative of the population thought to benefit from it.
Because this was a retrospective study (Aronow, 1987), the authors were limited to information that had been recorded in the patients' charts or (in the case of the control group) data recorded in an epidemiologic study, although all records were abstracted using the same protocol and all followup interviews were conducted using an identical instrument and process. Data on the timing of followup (how long after injury, acute hospital discharge, and rehabilitation discharge the outcome data were collected) were not available. GCS data also were unavailable. Finally, the use of a proprietary outcome instrument prevents comparison of their data to other studies.
A retrospective multicenter study of 140 patients admitted between 1990 and 1991 to one of eight rehabilitation hospitals was the best of these studies (Heinemann, Hamilton, Linacre, et al., 1995). Although the study was retrospective, all of the participating hospitals were prospectively collecting data using the Uniform Data Set for Medical Rehabilitation (Granger, Hamilton, and Sherwin, 1986). Intensity of therapy was defined either by the number of billed hours of individual therapeutic modalities (physical therapy, occupational therapy, speech and language services, and psychological services) or by all services combined. The authors examined whether a higher level of services was associated with better motor and cognitive FIM scores, achievement of motor or cognitive potential ([D/C FIM-admit FIM]/[100-admit FIM]), and efficiency of change ([D/C FIM-admit FIM]) at the time of discharge.
An analysis of the interrelationships between intensity and severity of injury or other descriptors revealed that they were not independent. Intensity of treatment covaried with functional status at admission, patient demographics, and medical characteristics. This suggests that the functional status on admission is actually related to the therapy intensity the patient receives. It appears that the patients received more therapy if they were admitted with less cognitive function, had uninterrupted stays, had a longer delay to admission, were younger, and so forth.
Investigation of the relationship between intensity of therapy and their (Heinemann, Hamilton, Linacre, et al., 1995) various outcome measures (discharge motor and cognitive FIM scores, achievement of motor or cognitive potential, and efficiency of change) did not reveal any significant relationship for occupational, physical, or speech therapy intensities. There was also no significant intensity:outcome relationship for intensity of all therapies combined. Only the number of hours of psychologic work per day, usually delivered as cognitive therapy, were associated with any alterations in outcome. These alterations were improvements in discharge cognitive, FIM score, achieved potential gains in cognitive FIM score, and efficiency of cognitive recovery.
The major weaknesses of this paper (Heinemann, Hamilton, Linacre, et al., 1995) are the absence of a specific definition of TBI and lack of control for severity of injury as a confounding, predictive variable. It is unlikely that the admission FIM will cover all of the variance otherwise subsumed by GCS, PTA, and/or duration of unconsciousness (coma). There was no control over or description of differences in treatment between the involved hospitals. Also, the use of billing hours as the index of therapeutic intensity probably included time not spent directly in patient care. Finally, the authors only used one outcome measure (FIM), and there is no long-term followup. Despite these weaknesses, however, the use of prospective data collection and credible analytic techniques make this the most important paper to address the issue of the relationship between intensity of therapy and outcome. It is the only Class II study in this category.
A retrospective study (Spivack, Spettel, Ellis, et al., 1992) examined the influence on outcome measured at rehabilitation discharge of therapeutic intensity during the first treatment month and over the entire stay on 95 patients with TBI. The cohort consisted of patients with a complete set of records who had been admitted to a single inpatient rehabilitation unit between 1988 and 1990. A definition of TBI was not given. It was noted that not all patients were comatose on admission. LOS ranged from 20 to 412 days with a median of 58 days.
Intensity of treatment was calculated as hours of actual treatment performance measured in 15-minute intervals for PT, OT, ST, cognitive remediation, vocational services, neurophysiology, respiratory therapy, therapeutic recreation, and medical services. Intensity of treatment during the first month was the total hours of treatment during that month. Subjects were separated into high- and low-intensity groups based on the median split of treatment hours during the first month. The median was 76 hours with a range of 18 to 196 hours. Average daily intensity of treatment over the entire stay was calculated, and subjects were again classified into high- and low-intensity groups based on the median split. The median was 4 hours per day with a range of 1.4-12.25 hours. The authors (Spivack, Spettel, Ellis, et al., 1992) felt that the true time spent per weekday was probably about one-third higher, since these estimates did not take account of days when therapy could not be administered (passes, holidays, weekends, etc.).
GCS was measured within 24 hours of admission to the trauma hospital. Head AIS score, duration of coma, severity of extracranial injuries (highest non-head AIS), and time since TBI were also measured. The statistical method used to control for these confounding variables was unclear.
The independent variables were intensity of treatment during the first month of rehabilitation, average daily intensity of treatment over the entire LOS, and LOS. All of these independent variables were made binary using the median split method as described above.
The dependent variables were outcome measures. RLA scores were measured on admission and discharge. In addition, therapy-specific outcomes on admission and at discharge were assessed using a seven-point functional status scale developed by clinicians within each rehabilitation discipline. A principal components analysis was used with a varimax rotation conducted on the matrix of correlations among functional scale scores at admission to group the scores on various axes. This resulted in grouping along axes of physical performance, higher-level cognitive skills, and cognitively mediated physical skills. In addition, patients were rated on their RLA scores on admission and discharge.
The statistical methods for assessing the relationships between the independent and dependent variables were analyses of variance and covariance controlling for multiple comparisons.
Analysis of covariants (ANCOVA) with repeated measures analysis was used to investigate treatment intensity and LOS on the dependent variables of admission and discharge scores on physical performance, higher level cognitive skills, cognitively mediated physical skills, and RLA level. In this analysis, LOS and intensity of treatment during the first month of rehabilitation and LOS and average daily intensity of treatment over the entire LOS were separately analyzed.
LOS significantly influenced outcome across all outcome groups. With respect to either intensity of treatment during the first month of rehabilitation or average daily intensity of treatment over the entire LOS, the only statistically significant relationship was between discharge RLA and 1-month treatment intensity. Spivak, Spettel, Ellis, and colleagues (1992) found a borderline nonsignificant relationship (p=0.06) between higher level cognitive skills and average daily treatment intensity. They also found a borderline nonsignificant relationship (p=0.07) for the triple interaction of RLA, LOS, and average daily treatment intensity. Based on this borderline relationship, the authors performed univariate ANOVA analysis on this interaction. This revealed a significant effect of high-intensity treatment during the entire stay on RLA scores on patients with longer stays. This relationship did not hold for patients with short lengths of stay. ANOVA analyses of age and LOS as confounding variables suggested that these variables could not explain the correlation.
There are a number of weaknesses in the paper by Spivak, Spettel, Ellis, and colleagues (1992). Because a precise definition of TBI was not provided, it is difficult to determine the parent population. Additionally, the focus of the analyses was on outcome measures that were derived in the unit and were, therefore, of unestablished validity and reliability. The major weaknesses in this study, however, are the use of the median split method to dichotomize the independent variables and the lack of powerful multivariate statistical methods.
In this case, the median split method is a dichotomizing method of convenience and does not necessarily reflect any underlying physiologic basis. The distribution of intensity times may be influenced by confounding influences of various origins, including brain and extracranial injury characteristics, patient personality, payer characteristics, and so forth. One method to force independent variables into binary distributions would be to determine split thresholds recursively in terms of their influence on outcome. Alternatively, intensity of treatment could have been analyzed during the first month of rehabilitation and average daily intensity of treatment over the entire LOS as continuous variables. The use of the median split method in dividing independent variables might have increased the likelihood of a type II error.
The other major weakness in the paper by Spivak, Spettel, Ellis, and colleagues (1992) is the lack of powerful, multivariate control for confounding variables. As was demonstrated (Heinemann, Hamilton, Linacre, et al., 1995), it is not proper to assume independence between intensity of therapy and severity of injury or other patient descriptors. The analysis would have been considerably strengthened by using regression-type analysis.
In the analysis of results, several inferences were made from the nonsignificant but borderline interactions between higher level cognitive skills and average daily treatment intensity (p=0.06) and the triple interaction of RLA, LOS, and average daily treatment intensity (p=0.07). Based on the latter borderline relationship, a significant effect was found of intensity of treatment during the entire stay on RLA scores on patients with long LOSs. Based on this interaction, suggestions were made on managing the intensity of treatment for patients with more severe injuries. However, the original interaction that inspired these suggestions was not significant (p=.07); consequently, the value of the suggestions is not substantial.
In one retrospective study (Blackerby, 1990), the influence on brain injury outcome of a change in mean daily therapeutic intensity that accompanied a major programmatic change at the study institution was investigated. The study took place at two commercial inpatient head injury rehabilitation provider units run by Rebound, Inc., a commercial provider of head injury rehabilitation services. The charts of all 149 patients with brain injury in the program between 1986 and 1988 were evaluated; 97 percent of the patients were admitted with a diagnosis of TBI. There was no description of TBI provided. Patients were either in a coma treatment program or an acute treatment program. For the prechange group, 55 percent were in the coma treatment program (54 of 98 patients), whereas only 27 percent of patients in the postchange group were in the coma treatment program (14 of 51 patients).
There was no precise measure of TBI severity. Confounding variables quoted in this study included age, level of function on admission, and length of time postinjury as measured on admission. The measure of function on admission was not specified. It was reported that the two groups did not differ with respect to these variables, although the method of handling them as confounding variables is not stated and the raw data are not provided.
The independent variable was intensity of therapy measured as mean number of daily therapy hours for all types of therapy combined. The two groups were formed in 1986 when the rehabilitation provider units altered the structure of their rehabilitation service delivery system. At this time, the intensity of inpatient rehabilitation was increased from an average of 5.5 hours per day to an average of 8 hours per day.
The dependent variable was inpatient rehabilitation LOS. The relationship between the independent and dependent variables was analyzed using t statistics, separately analyzing the coma treatment and acute treatment groups.
The results demonstrated a large change in average length of stay in both the coma and acute treatment programs following the programmatic changes. The variability in the LOS also decreased after the programmatic change. The only statistical examination was a t-test between pre- and postchange LOS for both the coma treatment program and the acute treatment program. Both of these changes were statistically significant as tested.
The differences between these groups in terms of cost was evaluated. The average daily cost for the rehabilitation programs was $785 per day with $350 representing the fixed costs. For the patients in the coma treatment program, the average savings would be $16,950 per patient. For the patients in the acute treatment program, the average savings would be $18,504. It was noted that such cost savings, as well as the decreased variability in LOS that appeared to accompany the change in mean daily therapeutic intensity, would be of use to insurance carriers in predicting and controlling costs.
There are a number of weaknesses in the paper by Blackerby (1990). A strict definition of TBI was not provided, making it difficult to determine the parent population. In addition, there was a lack of control for severity of TBI or other confounding variables. No data on these variables were provided.
The major weakness, however, was the lack of statistical controls for a number of potentially significant confounding variables that are intrinsic to this experimental design. It appears there were major changes in this rehabilitation delivery system that accompanied the increase in mean daily therapy intensity. The paradigm change was described as a change to a "naturalistic activity, total therapeutic day model" that apparently involved adaptations of those activities of interest to the individual before head injury. It was suggested that implementation of internal case management was part of the new system and that "senior clinical staff were added to the programs in the roles of clinical consultants and case managers, which increased staff experience and personnel." The occurrence of programmatic changes of such magnitude will, almost by definition, alter patient management in ways outside of those resulting from the increase in mean daily therapy intensity. If all of these changes could be described and quantified, their confounding influences could be addressed using multivariate statistics. In the absence of these data and such statistical analyses, it is difficult to interpret the results of this report.
Based on the current literature, there appears to be little evidence that therapeutic intensity, measured as hours of treatment, is related to the beneficial effects of acute, inpatient TBI rehabilitation when the analysis controls for confounding variables. The only Class II study (Heinemann, Hamilton, Linacre, et al., 1995) found no correlation between intensity of individual or grouped therapeutic interventions and outcome. The second study found statistically significant correlations only for discharge RLA and 1-month treatment intensity (Spivack, Spettell, Ellis, et al., 1992). Nonsignificant trends were reported toward associations between higher level cognitive skills and average daily treatment intensity and for a triple interaction of RLA, LOS, and average daily treatment intensity, but the interpretation of these trends is unclear in the absence of statistical significance or other supporting evidence. The third report (Blackerby, 1990) appears to have been so highly confounded by uncontrolled variables as to render questionable any comparative interpretation of findings.
There are a number of possible reasons why various intensities of rehabilitation do not appear to correlate with functional improvements. First, the effect of specific comorbidities was underinvestigated in these papers. Second, there is a lack of long-term followup in all three studies. Third, these studies did not examine the quality of treatments or the reasons the various therapies were applied.
Another potential explanation for the demonstrated lack of correlation between therapeutic intensity and outcome is that all patients were receiving enough therapy and that added hours did not make a difference. Similarly, the ranges of intensities of treatment (lack of treatment variability) may have been too limited to show differential effect. As Heinemann, Hamilton, Linacre, and others (1995) noted, the Health Care Financing Administration (HCFA) mandated 3 hours per day of therapy for each patient starting in 1983. The legislation may have decreased practice variation that, prior to the regulations, might have been wide enough to affect patient outcomes. Future studies should either consider suspending such constraints or including the influence of such mandated decreases in variation in therapeutic effort into the power calculations used to determine the minimal size of their patient populations.
Overall, however, it also is debatable whether hours of applied therapy is the proper index for therapeutic intensity. The impact of individual therapeutic disciplines may not be independent or even separable, and the time spent in each might not be the best index of their intensity.
The use of hours of applied therapy as the index for therapeutic intensity also raises the question of how to measure the "milieu effect" of comprehensive rehabilitation. The potential contributions to recovery that might arise from formal and/or informal patient-patient, patient-nurse, patient-therapist, and patient-TBI rehabilitation environments have not been addressed in any study to date. Particularly in units devoted to TBI, such a milieu effect should be taken into account in attempting to determine the mechanism of efficacy of the present rehabilitation efforts. This is particularly relevant to such questions as whether delivery of rehabilitation services to a similar group in a setting outside of a formal inpatient rehabilitation unit (i.e., a less expensive setting) is an equally efficacious and, therefore, acceptable alternative method of care delivery.
Future research into the question of intensity of inpatient rehabilitation must deal specifically with the limitations highlighted in the present body of literature. These deal specifically with the way the question has been asked and generally with the details of describing the patient population and the therapies applied.
The present unidimensional definition of intensity as hours of application appears to be neither an appropriate definition of intensity nor an adequate descriptor of the therapies. In order to examine the importance of hours of application, there must be a description of and control for the other aspects that make up each therapy. These include modalities used, therapist training, interactions between therapeutic disciplines, and so forth, as well as the milieu in which the therapies are delivered. For instance, it is questionable if it is valid to compare two separate physical therapy sessions solely in terms of time spent without addressing what is done within those sessions, who performs the therapies, which aspects of other treatment modalities (for example, cognitive therapy) might be imbedded, etc. Such confounding variables either need to be standardized (preferable) or described in a fashion amenable to subsequent statistical control.
It also is necessary to better describe the patient population being treated. It is highly unlikely that all people with TBI will receive optimal benefit from the same general therapeutic approach. It is critical that the types and magnitudes of impairments resulting from the TBI be described for the patient population, including both the severity of injury and the resultant degrees of physical and cognitive dysfunction. If adequate descriptions are provided, it will be possible to determine the interaction of the various facets of the individual treatment modalities with the types of impairment demonstrated by the people being studied. In addition, it will facilitate subsequent focused studies addressing matching treatment protocols to patient subtypes.
If treatments can be standardized and the patient population can be adequately described, it is possible that RCTs could be performed addressing hours of therapy as the independent variable and outcome as the dependent variable. With the proper standardization, the influence of general milieu also could be addressed by adding it as a second independent variable. Such investigations, if performed in fashions that are replicable and comparable between studies, should prove extremely valuable in furthering our understanding of optimizing types and intensities of treatments for people with specific, defined levels of TBI-induced impairments.
TBI-induced cognitive dysfunction manifests in a spectrum of changes in memory, language, concentration, physical problems, and various behavioral disorders. Several longitudinal studies serve to characterize the nature and extent of cognitive problems following TBI. In a study of United States servicemen discharged for medical and behavioral TBI sequelae (n = 2,243 of total discharge population of 1,879,724), 80 percent were discharged with mild dysfunction, 8 percent with moderate TBI, and 12 percent with severe TBI on the Abbreviated Injury Score for head injury (Ommaya, Dannenberg, Ommaya, et al., 1996). Servicemen who had mild TBI were 1.8 times as likely as other servicemen to be discharged because of behavioral problems. They also were 2.6 times as likely to be discharged for drug and alcohol problems and 2.7 times as likely to be discharged for criminal activities compared with other servicemen. The relative risks of discharge for medical reasons ranged from 7.5 for servicemen with mild TBI to 40.4 for servicemen with server TBI. Longitudinal studies in Sweden (Schalen and Nordstrom, 1994) and Scotland (Brooks, McKinley, Symington, et al., 1987) found outcomes in TBI victims at 5 and 8 years and 7 years postinjury, respectively, that included persistent neurophysical pathology, language disorders, dependence on relatives, and myriad mental or behavioral problems, such as hostility, childish behavior, anger, distraction, and fatigue.
Seeking a theoretical foundation for development of effective interventions, scientists and clinicians have generated a number of models of cognition. These models differ by discipline but generally include the concept that cognition operates as an integrated system consisting of performance fields and various functions within these fields (Goldstein, 1995). The fields include attention, memory and learning, thinking or mental organization, affect and expression, and executive functions. Brain injury will affect overall performance and, depending on the nature and severity of the injury, may have differential effects on performance within these fields. Various strategies are used to help improve damaged intellectual, perceptual, psychomotor, and behavioral skills (Wehman, West, Fry, et al., 1989). These systems of interventions are designed to increase daily functional abilities by improving or augmenting deficits in processing and interpreting information (Coelho, DeRuyter, and Stein, 1996).
One general distinction that serves to classify therapeutic strategies is that between restorative and compensatory cognitive rehabilitation. Restorative cognitive rehabilitation (RCR) is based on the theory that repetitive exercise can restore lost functions (Coelho, DeRuyter, and Stein, 1996). RCR targets internal cognitive processes, with the goal of generalizing improvements to real-world environments. Techniques used in RCR include auditory, visual, and verbal stimulation and practice, number manipulation, computer-assisted stimulation and practice, performance feedback, reinforcement, video feedback, and meta-cognitive procedures such as behavior modification. Refinements in RCR methods involve extensive clinical evaluation to identify specific cognitive processes which are damaged and individual remediation protocols targeting those processes (Sohlberg and Mateer, 1989).
Compensatory cognitive rehabilitation (CCR) strives to develop external, prosthetic assistance for dysfunctions (Wehman, Kreutzer, Sale, et al., 1989). It does not rely on the ability to generalize learning or the restoration of lost abilities. CCR uses visual cues, written instructions, memory notebooks, watches, beepers, computers, or other electronic devices to trigger behavior. Therapists assist by simplifying complex tasks, capturing the patient's attention, reducing distractions, and teaching self-monitoring procedures. CCR also includes jingles, mnemonics, verbal rehearsal, and paraphrasing. The concept of CCR has been expanded to include modification of the behavior of family members, teachers, and other support people present in the life of a person with TBI (Ylvisaker and Feeney, 1996). The adapted behavior of communication partners combines with the technical assistance of prosthetic devices and external cues to provide an environment of supported cognition.
RCR and CCR are not mutually exclusive and are commonly mixed in therapeutic programs for TBI. Restorative training is often enhanced by cues, mnemonics, and other compensatory prosthetics. In the absence of evidence for the differential effectiveness of these interventions, clinicians are compelled to combine and provide protocols according to their experience.
Some insurance programs do not pay for cognitive therapy as a stand-alone treatment or as a clearly defined component of a treatment protocol. Therefore, RCR and CCR techniques may be components of a rehabilitation program that is more traditionally defined and thus eligible for payer reimbursement. For example, many inpatient and TBI day treatment programs use speech and language pathology treatment principles to provide cognitive remediation within a broad and more widely accepted program context of occupational therapy, physical therapy, speech therapy, community integration, and vocational rehabilitation. As a consequence, it is difficult to distinguish the effect of the cognitive strategy from that of the other interventions being applied.
Experts in cognitive rehabilitation have developed specific measures for many of the functions impaired by brain injury. These measures, frequently used by researchers in published studies, are also used by clinicians to diagnose deficits and make decisions about treatment planning. Many also are used to test whether results in patients are consistent with various theories of cognition.
| Number of tests found to have a positive effect or association | Number of tests done without a positive effect or association | Proportion of positive effects found | ||||||
|---|---|---|---|---|---|---|---|---|
| Cognitive Domain and Associated Tests | RCTs (a) | Comparative studies (b) | Correlational studies (c) | RCTs (d) | Comparative studies (e) | Correlational studies (f) | RCTs & Comparative a+b. a+b+d+e | Correlation Studies c. c+f |
| Attention and orientation | ||||||||
| Digits | 0 | 1 | 1 | 3 | 3 | 3 | .14 | .25 |
| Mental Control | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| Trails A & B | 0 | 0 | 3 | 1 | 1 | 1 | 0 | .75 |
| PASAT | 0 | 1 | 2 | 2 | 1 | 0 | .25 | 1.0 |
| Test d2 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| Continuous Test of Attent. | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 1.0 |
| Divided Attention | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| Ruff 2 & 7 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| Letter Cancellation | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| Time Estimation | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| Attention to Task | 0 | 1 | 0 | 0 | 0 | 0 | 1.0 | 0 |
| Attention Rating Scale | 0 | 1 | 0 | 0 | 0 | 0 | 1.0 | 0 |
| WMS Attent./Concentr. | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 0 |
| Digit Symbol | 0 | 0 | 1 | 0 | 1 | 1 | 0 | .50 |
| Ruff-Light Trail | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 |
| Tactual Performance | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 1.0 |
| Choice Reaction Time | 0 | 1 | 0 | 0 | 0 | 0 | 1.0 | 0 |
| Simple Reaction Time | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| Vigilance | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| Totals | 0 | 5 | 9 | 12 | 11 | 7 | .18 | .56 |
| Memory | ||||||||
| WMS General | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 0 |
| WMS Verbal | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 0 |
| WMS Visual | 0 | 0 | 2 | 2 | 1 | 0 | 0 | 1.0 |
| WMS Delayed Recall | 0 | 0 | 1 | 0 | 0 | 1 | 0 | .5 |
| WMS Memory Quotient | 0 | 1 | 0 | 0 | 0 | 0 | 1.0 | 0 |
| WMS Logical Memory | 0 | 0 | 2 | 3 | 2 | 0 | 0 | 1.0 |
| WMS Paired Associates | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 1.0 |
| Rivermead Beh. Mem. Test | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| Everyday Memory Quest. | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| Calif. Verb. Learn. Test | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 |
| Rey Complex Figure | 0 | 0 | 1 | 1 | 1 | 0 | 0 | 1.0 |
| Rey Audit. Verb. Learn. | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| Block Span Learning | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| Benton Vis. Memory Test | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| Taylor Complex Figure | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 0 |
| Buschke Select. Remind. | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 1.0 |
| Recalling Sentences | 1 | 0 | 0 | 0 | 0 | 0 | 1.0 | 0 |
| Totals | 1 | 1 | 8 | 12 | 7 | 6 | .10 | .57 |
| Verbal & Language | ||||||||
| WAIS-R Information | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 |
| WAIS-R Vocabulary | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 1.0 |
| Language Competence | 1 | 0 | 0 | 0 | 0 | 0 | 1.0 | 0 |
| Word Fluency | 0 | 0 | 0 | 0 | 1 | 2 | 0 | 0 |
| Mill Hill Vocabulary | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 |
| Token Test | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 |
| Totals | 1 | 0 | 1 | 0 | 2 | 5 | .33 | .17 |
| Construction | ||||||||
| Parquetry Block Design | 1 | 0 | 0 | 0 | 0 | 0 | 1.0 | 0 |
| WAIS-R Block Design | 0 | 2 | 1 | 1 | 0 | 0 | .67 | 1.0 |
| Object Assembly | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 |
| Rey Complex Figure Copy | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 1.0 |
| Totals | 1 | 2 | 2 | 1 | 1 | 1 | .60 | .67 |
| Concept Formation & Reasoning | ||||||||
| WAIS-R Similarities | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 0 |
| WAIS-R Picture Arrangem. | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 1.0 |
| WAIS-R Picture Complet. | 0 | 1 | 0 | 0 | 0 | 1 | 1.0 | 0 |
| WAIS-R Arithmetic | 0 | 1 | 1 | 0 | 0 | 0 | 1.0 | 1.0 |
| Making Inferences | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| Raven's Progress. Matrices | 0 | 1 | 0 | 0 | 0 | 0 | 1.0 | 0 |
| Category Test | 0 | 0 | 1 | 0 | 0 | 2 | 0 | .33 |
| Wisconsin Card Sorting | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 0 |
| Comprehension | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 1.0 |
| Totals | 0 | 3 | 4 | 1 | 3 | 5 | .43 | .44 |
| Executive Functions & Motor Performance | ||||||||
| WISC-R Mazes | 0 | 0 | 1 | 0 | 0 | 1 | 0 | .50 |
| Austin Maze | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| Hals. Reit. Finger Tapping | 0 | 0 | 0 | 0 | 2 | 1 | 0 | 0 |
| Grooved Pegboard | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 1.0 |
| Grip Strength | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 |
| Totals | 0 | 0 | 2 | 0 | 3 | 3 | 0 | .44 |
| Batteries & Global Tests | ||||||||
| WAIS-R Full Scale I.Q. | 0 | 0 | 1 | 0 | 0 | 1 | 0 | .5 |
| WAIS-R Verbal I.Q. | 0 | 0 | 1 | 0 | 2 | 1 | 0 | .5 |
| WAIS-R Performance I.Q. | 0 | 1 | 3 | 0 | 1 | 1 | .33 | .75 |
| Russell Neur Av. Imp. Rat. | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| San Diego Neuro. Test Bat. | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| Wide Range Achiev. Test | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 |
| Hals. Reit. Impair. Index | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 1.0 |
| Totals | 0 | 1 | 6 | 1 | 4 | 4 | .17 | .60 |
| Miscellaneous & Clinic-Specific Tests | ||||||||
| Adolescent Word Test A | 1 | 0 | 0 | 0 | 0 | 0 | 1.0 | 1.0 |
| Adolescent Word Test B | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 1.0 |
| Adolescent Word Test C | 1 | 0 | 0 | 0 | 0 | 0 | 1.0 | 1.0 |
| Adolescent Word Test D | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 1.0 |
| Picture Vocabulary Test | 1 | 0 | 0 | 0 | 0 | 0 | 1.0 | 1.0 |
| Word Association Subtest | 1 | 0 | 0 | 0 | 0 | 0 | 1.0 | 1.0 |
| Understanding Metaphors | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 1.0 |
| Peabody Picture Vocabulary | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 1.0 |
| Ambiguous Sentences | 1 | 0 | 0 | 0 | 0 | 0 | 1.0 | 1.0 |
| Listening to Paragraphs | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 1.0 |
| Neale Analysis of Reading | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 1.0 |
| Pursuit Rotor | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 1.0 |
| Sentence Assembly | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 1.0 |
| Recreating Sentences | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 1.0 |
| Single Reaction Time | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 1.0 |
| Choice Reaction Time | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 1.0 |
| NYUMT Acq. Rec. Scaled | 1 | 0 | 0 | 0 | 0 | 0 | 1.0 | 1.0 |
| NYUMT Acq. Rec. Stand. | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 1.0 |
| Memory Index Scaled | 1 | 0 | 0 | 0 | 0 | 0 | 1.0 | 1.0 |
| Memory Index Standard | 1 | 0 | 0 | 0 | 0 | 0 | 1.0 | 1.0 |
| VerPa | 1 | 0 | 0 | 0 | 0 | 0 | 1.0 | 1.0 |
| VisPa | 1 | 0 | 0 | 0 | 0 | 0 | 1.0 | 1.0 |
| TeachWare Screen. Module | 1 | 0 | 0 | 0 | 0 | 0 | 1.0 | 1.0 |
| Name Writing | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 1.0 |
| Totals | 11 | 0 | 1 | 10 | 2 | 0 | .48 | 1.0 |
| GRAND TOTALS | 14 | 12 | 33 | 37 | 33 | 31 | .27 | .52 |
Note: Tests were placed into categories consistent with taxonomy provided by Lezak (1995)
Second, in this example, do high scores on the PASAT accurately predict whether the patient's attentional performances will function adequately in the context of work or social situations in which distraction and other demands are present? More generally, do the measures used to assess the effectiveness of cognitive rehabilitation predict improvement in real life function?
Activities of daily living (ADLs).
Long-term measure of disability (restriction or, as the result of an impairment, inability to perform an activity in the manner or within the range considered normal for a human being).
Long-term measure of impairment (loss or abnormality of psychological, physiological, or anatomical structure or function).
Independence, relationships, family life, satisfaction.
Long-term financial burden.
In the context of a systematic review, "direct" evidence comes from comparative studies that examine the effects of cognitive rehabilitation on measures of these outcomes. Arc 2 represents the direct effect of cognitive rehabilitation on measures of employment such as return to work and job retention.
Measures used in these studies that approximated important health outcomes were the Functional Independence Measure (FIM) (Novack, Caldwell, Duke et al., 1996), Observed Everyday Memory Failures (EMFs) (Schmitter-Edgecombe, Fahy, Whelan et al., 1995), the Rabideau Kitchen Evaluation Revised (RKE-R) (Neistadt, 1992), the Katz Adjustment Scale (KAS) (Ruff and Niemann, 1990), and a variety of inventories designed to measure anxiety, communication, and relationships (Helffenstein and Wechsler, 1982). In addition, these studies used neuropsychological test batteries and other intermediate measures of cognitive function to evaluate treatment effect.
In two studies, treatment produced statistically significant effects on relevant outcome measures. In one study (Schmitter-Edgecombe, Fahy, Whelan, et al., 1995), individuals trained in the use of notebooks and equipped with wristwatch alarm cues had fewer EMFs than those who did not have the compensatory devices. However, the effect was not present at 6-month followup. In the second study (Helffenstein and Wechsler, 1982), clients who received compensatory training had better results than those given nontherapeutic attention on one variable from an anxiety scale and three variables from a communication scale, and they had better performance on the Interpersonal Relationship Rating Scale and Independent Observer Report Scale. Six scales were used in this study, and the number of variables per scale, as well as group means, were not provided.
There is no direct evidence from randomized trials of the effect of cognitive rehabilitation on employment.
Participants were evaluated with 13 neuropsychological tests, the Katz Adjustment Scale (KAS) relative scale, and a measure of employment. People who were gainfully employed, either part time or full time, or were actively engaged in a realistic school program were considered employed. There were treatment effects on 3 of the 13 neuropsychological tests. Client attrition resulted in a reduction of participants at the time of followup. Of 18 people in the treatment group, 9 were employed at followup (50 percent). Of 13 people in the control group, 5 were employed (38 percent). The statistical significance of this difference was not reported.
Because of the potential and unknown differences between treatment and control groups, interpretation of these results is difficult. The authors (Prigatano, Fordyce, Zeiner, et al., 1984) did not specify why clients in the control group, although referred to NRP, did not participate. It is possible that the same factor or factors that caused them not to participate in NRP operated to influence their employment outcomes (in either direction). This Class II(b) study does not provide evidence for or against the effect of cognitive rehabilitation on employment. However, it provides limited evidence of the effect of the intervention on some intermediate measures of cognitive function.
A number of individual tests of cognition, such as the PASAT, were used in the six RCTs. In addition, three of the studies also used a full battery of neuropsychological subtests, two of which used the San Diego Neuropsychological Test Battery (SDNTB). Three studies produced treatment effects. Outcomes for one (Thomas-Stonell, Johnson, Schuller, et al., 1994) were a computerized screening module and a neuropsychological battery. No followup testing was conducted. Outcomes for the second study (Twum and Parente, 1994) were number of words and colors recalled immediately after practicing mnemonic techniques with the words and colors. No followup testing was conducted. Outcomes for the third study (Kerner and Acker, 1985) were a Memory Index (MI) task and an Acquisition Recall (AR) task, measured in scaled and standard forms. The treatment group received CACR targeting memory retraining. A control group used computers to create graphics, and a second control group had no intervention. With three groups and two forms of measuring each of the two tests, 12 effects were possible. Treatment effects were produced on 5 of the 12 measures at posttreatment. Improvement by the treatment group was not maintained at 2 week followup; however, the two control groups did not receive a followup test, so group differences in the decline were not measured.
Two of the three studies for which there was no treatment effect (Ruff, Baser, Johnston, et al., 1989; Ryan and Ruff, 1988) compared equal amounts of structured cognitive rehabilitation programs with unstructured activities, providing the greatest number of treatment hours among the RCTs in this review. The third (Niemann, Ruff, and Baser, 1990) compared equal hours (36 total) of attention remediation with memory remediation. For all three studies, clients in both treatment and comparison groups improved from pre- to posttreatment. This result underscores the previous suggestion that more may be learned about treatment effects by comparing intervention with no intervention rather than comparing one form of intervention (i.e., structured) with another form (unstructured) in a design that provides equal amounts of time and stimulation. Also, this result suggests there may be a general effect of stimulation, perhaps interacting with spontaneous recovery, that exceeds the effect of the intervention.
To conclude, there is evidence from three small Class I trials that the restorative technique of practice, both with and without the aid of a computer, operates to improve short-term recall on laboratory tests of memory for people with TBI.
Measures used to evaluate treatment effect included tests developed by the clinic or research project as well as established neuropsychological tests such as the PASAT, WAIS-R, Taylor Figure, and Digit Symbol. Of 36 intermediate tests performed, 2 of the 3 studies produced treatment effects on 9 tests. Group means were not presented, preventing an assessment of the magnitude of improvement. As with the RCTs for this category, equal amounts of stimulation were provided treatment and control groups. Improvements from posttreatment to followup suggest the presence of spontaneous recovery. These small, Class II(b) studies provide limited evidence that CACR improves performance on laboratory tests of cognition for people with TBI.
As discussed earlier, although the evidence is limited, there is some suggestion that certain cognitive rehabilitation methods improve performance on neuropsychological tests and other laboratory-based methods of evaluating cognitive function. The next question addresses the second link in the indirect path from intervention to relevant outcome.
No studies meeting the criteria for this review reported an association between laboratory-based measures of cognitive function and health outcomes such as functional independence, ADLs, or measures of everyday memory.
In all, 123 tests of cognition were administered. Two studies (Ezrachi, Ben-Yishay, Kay et al., 1991; Girard, Brown, Hashimoto et al., 1996) used numeric scales to measure productivity from 1 (worst) to 10 and 6, respectively. Four studies (Brooks, McKinlay, Symington, et al., 1987; Cicerone, Smith, Ellmo, et al., 1996; Fraser, Dikmen, McLean, et al., 1988; Ip, Dornan, and Schentag, 1995) used dichotomous measures of return to work or former level of productive activity. Two (Fabiano and Crewe, 1995; Najenson, Grosswasser, Mendelson, et al., 1980) placed clients into five and four categories of employment, respectively. Methods of analysis included regression, t-tests, chi-square, Wilcoxon rank sum, discriminant analysis, and factor analysis.
About half of the time, clients with higher intermediate test scores had returned to work or productivity, either full or part time, but not necessarily to the pretrauma level. In one study that used a regression analysis (Girard, Brown, Hashimoto, et al., 1996), 9 of 28 test scores, combined with 3 demographic characteristics, accounted for 30 percent of the variance in outcome; 19 of the tests did not help explain the difference in employment outcomes. In another study (Fabiano and Crewe, 1995) intermediate test scores were used in a discriminant analysis to derive a formula for predicting employment status. With this method, high scores on tests accurately predicted full-time employment 62 percent of the time, and low scores on tests accurately predicted unemployment 67 percent of the time. These proportions indicate that, while there appears to be some relationship between intermediate measures of cognition and employment, the association is not strong.
Although research designs without control groups are limited, they can be a source of hypotheses which could be tested in controlled trial settings. This section highlights insights from studies with uncontrolled research designs identified in our literature search.
The other eight studies either compared clients' performance from baseline phase to treatment phase, provided the same or similar treatments to different matched groups, or combined group and individual methods of measurement. In general, results indicate that for the selected clients treated in these clinical studies, one-on-one interaction with therapists in a rehabilitation environment is likely to improve individual performance on targeted laboratory tasks. Because the studies are not comparative, the improvement observed does not contribute to the body of evidence about the intervention being provided. However, the fact that clients do in fact improve gives rise to innovations in rehabilitation technology that may be useful to people with TBI and thus warrant further evaluation.
All participants had significant decreases in EMFs during treatment. During return-to-baseline, EMFs increased for 11 of the 15 participants; five increases were statistically significant. The results of this study suggest that the use of an electronic cueing device decreases EMFs for some people with TBI. These findings also contribute to the evidence for the link represented by Arc 1 of the causal pathway. The observational design of this study weakens its value as evidence of effectiveness. However, in considering that the nature of most of the interventions reviewed here are not individually adapted and on face value do not appear to be as pragmatic as an effective reminder device, this study is useful in that it generates a hypothesis about an intervention that may have the potential to prosthetically improve memory for a person with TBI.
Very few controlled studies of cognitive rehabilitation have examined health outcomes or employment. Two small randomized controlled trials (Class I) and one observational study provide evidence of the direct effect of compensatory cognitive devices (notebooks, wristwatch alarms, programmed reminder devices) on the reduction of EMFs for people with TBI. A second randomized controlled trial provides evidence that compensatory cognitive rehabilitation reduces anxiety and improves self-concept and interpersonal relationships for people with TBI.
In the absence of strong and sufficient evidence for a direct effect of cognitive interventions on health and employment, we examined a causal pathway linking cognitive rehabilitation to intermediate measures of cognition and subsequent associations between those measures and health or employment. Two small randomized controlled trials (Class I) provide limited evidence that practice and CACR improve performance on laboratory-based measures of immediate recall. However, no studies evaluated the link between cognitive tests and health outcomes, and associations between performance on cognitive tests and posttrauma employment and productivity were inconsistent.
Identifying and evaluating outcomes that are relevant to people with TBI and their families is the first priority of a research agenda. Among the studies we reviewed, perhaps the most pragmatic outcome measure used was that of everyday memory failures. It is possible that the absence of treatment effect in these studies could be a function of the study's lack of relevance in the lives of the people being evaluated, represented in outcome measures and interventions that have little meaning to those people.
It is also important to identify the laboratory tests that are strongest and most reliable in their ability to measure cognitive function in relevant contexts, and to standardize their use across research projects and hospital and clinical settings.
Two other questions for future research on topics not specifically addressed in this review are: (1) When is the client ready for the intervention? and (2) What are the markers of that readiness? Large, multicenter comparisons may provide initial information for a research design to investigate these questions.
In general, the studies in this review that did not produce a treatment effect compared one form of cognitive rehabilitation with another form, CACR to non-CACR practice, and were specific to unstructured rehabilitation methods. Treatment effects were not observed when one kind of remediation was compared with another when there were equal levels of stimulation for both treatment and comparison groups. What are the differential effects of general stimulation and technology? As TBI rehabilitation technology grows, costs escalate. Consequently, certain subsets of the total population of survivors--those with liberal insurance policies and/or private money--will receive the intervention. It is important for clients as well as payers to know if the new technology leads to improvement or whether the increased level of stimulation used to deliver the technology results in the improvement.
The goal of supported employment is to enable people with severe long-term or permanent deficit to resume a productive life through on-site aid and advocacy provided at the place of employment. Programs in supported employment began in the late 1970s as university-based demonstration projects and then became a part of government-sponsored rehabilitation programs. They have been applied to a wide range of populations who were previously considered unemployable, particularly people with mental retardation, but also including people suffering from neural, psychiatric, and physical disabilities (Wehman, Revell, Kregel, et al., 1991). More recently, the techniques have been applied to help survivors of TBI resume a productive life.
Chronic unemployment has both a personal and a social cost. For the person, regular work is an important source of personal satisfaction and social identity (Partridge, 1996). It not only may provide financial resources, but it also forms the basis of self-image and a claim on social recognition and reward (Shepherd, 1981). Work and a sense of vocation can contribute to a personal sense of worth and competence, a sense of belonging and well-being, and to other psychological states essential to mental health (Pettifer, 1993). The fundamental value of work is illustrated by Roe's (1956) suggestion that it is the only social role that can fulfill all the stages of Maslow's (1987) hierarchy of needs, ranging from safety, through esteem, to self-actualization. Chronic unemployment, especially beginning early in life, is an important threat to personal mental health. Survivors of TBI often were injured just as they approached or reached their full potential as workers. The social cost is evident when we consider that more than 60 percent of survivors of TBI are men under 35 years of age (Wehman, West, Fry, et al., 1989). This is precisely the population who tend to be highly skilled workers, at the peak of their powers, with 30 years or more of productive life remaining. That contribution to society is foreclosed by their absence from the work force or by the greatly diminished roles they must play after injury. And it is not only gainful employment that is lost to the person and to society, the loss also includes the whole variety of a person's productive work as a student, homemaker, and other important social contributions which the person might have made (Sander, Kreutzer, Rosenthal, et al., 1996).
Job placement. This includes (a) matching job needs to client abilities and potential, (b) facilitating employer and client communications, (c) facilitating caretaker communications, (d) arranging travel arrangements or training, and (e) analyzing the job environment to detect potential problems.
Job site training and advocacy. This emphasizes the active role of the employment specialist, job coordinator, or job coach, who is often cited as the key professional in supported employment programs (Wehman, West, Fry, et al., 1989; Ellerd and Moore, 1992). The job coach serves functions usually left to the employer in conventional vocational rehabilitation (e.g., training). The job coach also is proactive in identifying problems and designing solutions in cooperation with all the parties involved.
Job retention and follow-along. A continuing, proactive process in which the job coach tries to anticipate problems and intervene early to prevent crises from disrupting the client's adapted job placement. This assistance to the client is of indefinite duration, although it is expected to diminish over time (Wehman, Sherron, Kregel, et al., 1993).
The hallmark of supported employment methods is that they are applied on the job, in the actual work environment, to help the client succeed. Off-job training and practice to prepare the client for work may be an important prelude to supported employment in some programs, but the job coach always accompanies the client to the job site to work out on-the-spot solutions to problems as they arise and to mediate between employer and client. This problem-solving-in-situ is a defining principle of the method of supported employment (Kreutzer, Wehman, Morton, et al., 1988). Finally, these programs usually aim at competitive employment, usually defined as employment in a setting about 95 percent occupied by workers without disabilities and paying at least the official minimum wage (Wehman, Kreutzer, West, et al., 1990; Ellerd and Moore, 1992). They do not aim at placement in sheltered workshops or other settings designed primarily to accommodate the needs of disabled workers. There is a strong commitment to placing the client in the highest job position possible and to approach or exceed the preinjury level of work.
Supported employment is necessary only in cases where standard vocational rehabilitation is not sufficient to secure the desired level of employment for a survivor of TBI. In this respect, supported employment could be considered an extension of vocational rehabilitation into the actual job site as the final stage of helping a particular survivor resume a productive life. Studies of postinjury employment in which survivors are sorted by severity of injury show that not all survivors of TBI require this extra step. People suffering mild injury (GCS = 13) are usually reemployed at high rates: from about 60 to 85 percent within 1 year postinjury, and this high rate is maintained up to 15 years later (Dikman, Temkin, Machamer, et al., 1994; Schwab, Grafman, Salazar, et al., 1993; Edna and Cappelen, 1987; Fraser, Dikman, McLean, et al., 1988). In those same studies, people suffering from moderate or severe injury do not fare as well. The reemployment rates for moderate injury (GCS = 9 to 12) for the same periods are 50 to 60 percent, and for severe injury (GCS = 8), reemployment ranges from 20 to 30 percent.
The GCS alone may not always be the best predictor of employment success in multivariate analyses including other severity measures (Abrams and Toms Barker, 1991). It seems evident, however, that supported employment is most necessary for severe injury because regular vocational rehabilitation programs are insufficient. Even a variety of other interventions before job placement--such as cognitive training, with and without occupational trials, and behavior modification--show only limited success (Wehman, Kreutzer, West, et al., 1990). In addition, about one-half of survivors with moderate TBI and at least 15 to 20 percent of survivors with mild cases also might benefit from supported employment programs.
Ideally, as an extension of vocational rehabilitation, supported employment would address the problems that lead to lost jobs. Devany and colleagues at the Medical College of Virginia (Devany, Kreutzer, Halberstadt, et al., 1991) found that survivors of TBI who had trouble with reemployment suffered from four kinds of difficulties:
Somatic problems, like debility, loss of balance, and motor deficiencies.
Cognitive problems, like loss of memory, inability to focus attention, obsessions, and indecisiveness.
Behavioral problems, like inertia, restlessness, depression, and impatience.
Communication and social problems, like contentiousness and various disorders of speech and writing.
They also found that the survivors' scores on the Minnesota Multiphasic Personality Inventory (MMPI) showed peaks on scales 8 (schizophrenia), 4 (psychopathic deviate), and 2 (depression), in that order of magnitude. Valid MMPI scores might be problematic with this population, but the pattern found seems to match the common clinical impression. A configuration of 8-4-2 on the MMPI indicates a depressed person with severe interpersonal and social deficits who could easily alarm or offend others. Add this to the various motor and cognitive deficits already noted, and we have a formidable set of obstacles to placing and maintaining a person with a severe TBI in a job setting. The underlying assumption of the supported employment model is that all people referred to the program are employable under suitable conditions (Wehman, Sherron, Kregel, et al., 1993). Successful programs focus on finding or making those conditions in support of client success at work.
Of the 93 articles retrieved for review, 42 were excluded based on initial exclusion criteria, reducing the total number of articles to 51. Two investigators read all articles retrieved through the database search, as well as five additional articles acquired from reference lists and recommendations from peers, for a total of 56 articles.
There is no direct evidence from randomized trials about the efficacy of supported employment.
No Class I or IIa studies of supported employment were found in the literature. In one prospective, controlled, observational study, Haffey and Abrams (1991) measured job placement and retention rates of 130 participants in a program of supported employment, the "Work Reentry Program" or WRP. These results were compared with those of 35 clients in a day-treatment program and 76 individuals who had received no postacute rehabilitation (the "comparison group"). Participants in the WRP program were recontacted every 6 months for up to 3 years. Other subjects were followed for varying amounts of time over 3 years, depending on when they entered the study. A total of 87 (67 percent) of the 130 participants entering the program were placed in employment. Followup for the 87 placements was as follows:
1 to 6 months of followup: 18 participants.
7 to 12 months of followup: 23 participants.
13 to 18 months of followup: 17 participants.
19 to 24 months of followup: 15 participants.
> 24 months of followup: 14 participants.
The second series has been reported in a number of publications (Wehman, West, Fry, et al., 1989; Wehman, Kreutzer, West, et al., 1989; Wehman, Kreutzer, West, et al., 1990; Wehman, Sherron, Kregel, et al., 1993). These studies evaluated the outcomes of supported employment in a prospective registry study. In the first article cited, the sample included five survivors followed for 75 weeks (1.4 years); by the last article in the series the sample had increased to 115 consecutive referrals followed for up to 60 months (5 years). These individuals passed through two consecutive phases of vocational rehabilitation: first, the standard postrehabilitation services, then a supported employment program.
For convenience in the remainder of this report, we will refer to the first study as Haffey and Abrams and to the second series of studies, taken as a group, as the Virginia series, after the home of the researchers in the Medical College of Virginia.
Posttrauma vocational success in the Virginia series was compared with the rates of preinjury employment success of each client, who served as his or her own control in the study. Preinjury employment is thus taken as a baseline control for results in the two subsequent phases of intervention--the last of which was supported employment--as each client passed through the following history: Preinjury employment (baseline) => posttrauma employment (1st phase intervention) => supported employment (2nd phase intervention).
Measures of employment success in the Virginia series were (1) number of jobs held per client, (2) mean hourly wage, (3) mean monthly wage, (4) mean annual wage, (5) monthly employment ratio (MER). The last is an index of vocational success developed by the Virginia group. It is the ratio (with specific definitions of the two variables): number of months client employed/number of months client could have been employed (Wehman, Sherron, Kregel, et al., 1993).
Results were measured over 5 years of operation with measures of outcome taken weekly (Wehman, Kreutzer, West, et al., 1989). During that time, 80 of the 115 entering clients were placed in jobs, but it is not clear how many of the 115 were followed for all 5 years. In the whole series of studies, we have reports on 5 clients in 1989 (Wehman, West, Fry, et al., 1989) and 20 clients later in the same year (Wehman, Kreutzer, West, et al., 1989). In 1990, there is a report of 53 clients (Wehman, Kreutzer, West, et al., 1990) and in 1993 the total is 115 (Wehman, Sherron, Kregel, et al., 1993). From this pattern in the reports, we may infer that about five clients were followed for a full 5 years, 15 clients for between 4 and 5 years, 33 clients for at least 3 years, and 62 for less than 3 years.
There was no random selection or allocation to groups in either of the studies reviewed. In the Haffey and Abrams study, assignment to the two treatments and the on "comparison group" was "determined by factors that ordinarily lead to referral to rehabilitation services," according to the authors. (1) Clients in the WRP (supported employment program) were referred by the State rehabilitation department if they had employment potential "under the right circumstances" (which perhaps meant a program like the WRP). Clients believed to have "absolutely no employment potential" by rehabilitation counselors, the clients themselves, or family members were not admitted to the WRP. (2) The second treatment group (the day-treatment program) contained survivors for whom "competitive employment was not a current goal" because of medical problems, personal and family preference, economic disincentives (pension, social security), and other engagements (homemaker, student). (3) The comparison group was made up of consecutive discharges from inpatient TBI rehabilitation who did not elect to attend the WRP because they (a) thought the services unnecessary, (b) believed they were too disabled to work, (c) played a dependent role with caregivers, (d) feared jeopardizing benefits, or (e) were active substance abusers.
In the Virginia series, the sample was 115 consecutive referrals by clients' supervising physiatrists to the supported employment program. All met the following criteria: (1) age between 18 and 64 years, (2) severe TBI: GCS 8 for 6 hours, (3) strong evidence that the person could not work successfully without ongoing job support, like previous postinjury failure, client doubts, or doubts by physician, family, or counselors. No client was excluded simply for having cognitive, physical, or psychosocial deficits. Some of the studies in the series (1990) indicate that clients were also excluded on evidence of active substance abuse.
Both studies used some variant of the individual placement model of supported employment, but the two versions differed significantly. Both programs had extensive analysis of client characteristics, preferences, abilities, and deficits to guide optimum placement of the clients, the active participation of the job coach at the work site, and continuing but "fading" support for the client on the job. The analyses of client need and capacities and job requirements are extremely detailed in both programs, but Haffey and Abrams appear to use more behavioral criteria (like simulated work samples), and the Virginia group seems to rely more on screening and respondent information (see Wehman, Kreutzer, West, et al., 1989 for the screening form used). However, the program used in Haffey and Abrams had a component of preemployment training available to the clients which was not a feature of the Virginia program. Haffey and Abrams included two preemployment training sessions for the clients: (1) work hardening, using real and simulated work activity to develop "stamina, work competencies, work behaviors, and productivity levels"; and (2) the Transitional Employment Program (TEP), placing the client in a salaried capacity in the hospital dietary or environmental services department with a job coach for 3 to 4 months. These features are in contrast to the Virginia model, which is predicated on the "assumption ... that ... cognitive retraining, work adjustment, work hardening and social skills training, may be best provided at the job site while the person is already employed." This is a fundamental difference in approach which is made explicit by a later statement in the same place: "Supported employment does not promote job readiness training, but instead emphasizes using a person's current abilities and strengths" (Wehman, Sherron, Kregel, et al., 1993).
| Preinjury | No SE1 | SE | |
|---|---|---|---|
| Employment outcome | (n = 62) | (n = 37) | (n = 80) |
| Mean number of jobs/client | 2.04 | 1.24 | 1.49 |
| Mean hourly wage earned | $4.19 | $1.55 | $4.90 |
| Mean monthly wage earned | $508 | $107 | $658 |
| Mean annual wage earned | $6,101 | $1,290 | $7,899 |
| Monthly employment ratio | 0.40 | 0.13 | 0.67 |
SE = supported employment.
There is Class IIb evidence that supported employment can improve the vocational outcomes of TBI survivors. Almost all information about supported employment comes from two bodies of work, each of which use different experimental designs and different models of supported employment. The findings have not been replicated in other settings or by other centers, so the generalizability of these programs remains untested.
In the Virginia studies, the clients all had severe cases of TBI as rated by the GCS. In the Haffey and Abrams experiment, no GCS scores are given, but the data provided on severity of injury show median length of coma in the three groups ranging from 6 to 7 days, with the median value for the entire sample of 199 cases at 7 days and the overall range from 0 to > 30 days. In the 80 job-placed survivors of the Virginia series (Wehman, Sherron, Kregel, et al., 1993), the average length of coma was 48 days, and the range was from 0 to 182 days. Clearly, the Haffey and Abrams sample contained many people with moderate or even mild injuries, while the Virginia sample consisted entirely of people with severe injuries. We have already noted, in the Introduction to this report, that severity of injury has an important effect on vocational success.
The problems with the Virginia series are of another sort. They arise from the inherent limitations of the design itself, since case-control studies without separate control groups and unbiased allocation of participants are unable to untangle confounded variables. Repeated measures on a single group are bound to be confounded with variables for which there are no controls. An observation made by Wehman, Sherron, Kregel, et al. (1993) will illustrate the problem. They note that during the economic recession of 1990 to 1992--the worst in the United States since the 1970s--nearly 20 percent of their program participants lost their jobs due to layoffs. The design of the Virginia studies compares baseline levels of employment preinjury with subsequent performance under two levels of vocational rehabilitation, including supported employment as the final stage.
In the Virginia sample, the average age at injury was 24.8 years, and the average age at referral to the program was 30.9 years, making the average interval from injury to entry in the program 6.1 years. The average time to job placement after program entry is about 1 year more, and the subsequent followup in the series of studies under review ranges up to 5 years, with a substantial proportion of the clients at least 3 years into followup. Simple arithmetic discloses that the average time from preinjury employment to postinjury followup is on the order of 10 to 12 years, and for about half the clients the interval will be even longer. This is the time elapsed between baseline measures of preinjury vocational success and postinjury outcome measures under supported employment. It is a significant possibility that economic changes over a 10- to 12-year period (or more, for half of the sample) would have significant effects on employment. Those economic effects will be confounded with the effects of supported employment programs running at the same time, and there is no way to separate the two kinds of effects unless a control group of clients, without supported employment, is measured over the same interval. Likely, there are many other confounded variables at play in the same way, including unknown ones.
In spite of the problems mentioned, it remains true that all the programs of supported employment reviewed showed better rates of vocational success than the baseline expectations of survivors of TBI who received only standard postacute rehabilitation or even with special kinds of preemployment vocational counseling and training (see "Problems Addressed" section in the Introduction to this report). The success documented by the Virginia series with survivors with severe injuries is especially convincing in this respect. Supported employment appears to be a promising way to increase the vocational success of survivors of TBI, but the present literature does not give definitive proof of its effectiveness and does not provide enough clarity on why it works or guidance to the best applications of the method.
The greatest overall need for the evaluation of supported employment programs is a series of trials with adequate controls and unbiased allocation of clients to the conditions compared. The prototype of this kind of evaluation is the randomized, controlled trial (RCT), in which a representative sample from a population of survivors of TBI is randomly assigned to programs in supported employment and to various control conditions, which may include alternate interventions, no interventions, or both. These experiments may be very difficult or impossible to do because of the conditions under which rehabilitation programs operate. There may not be access to representative samples of survivors of TBI, for example, or it may be difficult or impossible to insulate the different experimental conditions from each other when the clients and caregivers from the different groups live in the same community and have informal social exchanges with each other. The same may be true for professional staff. Sometimes ideal experimental conditions must be approximated and sufficient measures taken to allow supplementary regression analyses to clarify confounded variables or covariance analyses to control for unavoidable allocation biases. These are the realities of field research. However, we need better studies than we now have to clarify the effects of supported employment.
In addition to the main independent variables of intervention and control groups, a number of measures of client characteristics may be reconsidered in light of past research. On the matter of injury severity, for example, the general rule holds that clients with moderate to severe TBI injuries (GCS < 10) are most at risk for poor vocational outcomes in unsupported work settings (see Introduction to this review). Stambrook, Peters, Deviaene, et al. (1990) found that admission GCS scores, low preinjury vocational status, older age, and physical and psychological problems were the best discriminators of postinjury success.
The Virginia studies focus entirely on clients with severe injuries (GCS < 8) because that is where most of the problem lies. However, the link between severity of injury and unemployment is not perfect, and a substantial group of survivors with even mild injuries (15 to 40 percent) fail at work. In a study of predictors of vocational success 1 year after injury (Cifu, Keyser-Marcus, Lopez, et al., 1997), the Virginia group found several effective measures, including injury severity (admission GCS, highest GCS, length of coma, and length of PTA); acute measures of physical functioning (admission FIM, admission DRS, discharge DRS); cognitive functioning (logical memory delay); and behavioral functioning (admission RLAS, discharge RLAS, NRS excitement factor). But very long intervals can elapse between injury and reemployment: an average of 5 to 7 years or more is common, with half of clients waiting longer times (Wehman, Sherron, Kregel, et al., 1993; Courtney, 1992; Roessler, Schriner, and Price, 1992). There is a need for finer discrimination among the states of deficit at the time of entry into employment programs than is afforded by GCS scores in the acute phase.
One possibility is to use more proximate assessments of deficit which assess abilities needed in the workplace. If supported employment programs are aimed at clients with greatest risk of vocational failure--as in the Virginia series--postacute measures may be better predictors of postinjury work success. For example, some cognitive deficits (executive function/flexibility), emotional disturbances (aggressiveness, depression), and low ADL ratings appear to be better predictors of employment after TBI than severity of injury (Crepeau and Scherzer, 1993). The research done by the Virginia group on "easy" and "difficult" groups of clients to place and train in employment settings (Wehman, Kregel, Sherron, et al., 1993) may be another basis for better discrimination of client characteristics and better matches between clients and work settings, as is the work done on the kinds of problems leading to job loss in supported employment programs for clients with TBI (Sale, West, Sherron, et al., 1991).
Another class of independent variables might be called cointerventions and concurrent variables. Cointerventions are the unprogrammed interventions made by family, coworkers, employers, and so on that may affect success or failure on the job. These are difficult to identify and measure, but it is unrealistic to assume that the job coach is the only helper or advocate of the client, and these other interventions may have powerful effects on outcome. An example of concurrent variables is the observation (Wehman, Sherron, Kregel, et al., 1993) that, in one instance, 20 percent of clients in a supported employment program lost their jobs to layoffs during an economic recession.
Also important with regard to outcome variables are length of followup and frequency of measurement of outcomes. Some studies take weekly measures (the Virginia series) and others longer periods, such as every 6 months (Haffey and Abrams, 1991). Generally, frequency of measurement depends on how detailed the knowledge of job adjustment needs to be for effective job coaching. In the early stages, close monitoring is necessary; as the job coach "fades," the measures may be more spaced. More important for assessing the efficacy of supported employment is the length of followup. We recommend that followup be an integrated part of all supported employment programs, as a built-in component, and that it go on indefinitely. The play of variables that determine vocational success may act over long periods of time, and adequate length of followup approximates the entire work career of the client. The example of the Virginia series, which made periodic updates on a cumulating sample, shows the value of this strategy.
Another issue related to outcome is the criterion of vocational success. If a broader criterion is adopted, it would extend the range of the methods of supported employment into those of supported activity. The list of primary areas of activity (Sander, Kreutzer, Rosenthal, et al., 1996), which includes homemaker, student, volunteer, and retired, as well as competitively employed, and specially employed (including supported employment), is one approach to a set of criteria for vocational success which is broader than simply work-for-wages. Another approach is age-appropriate activity, as proposed by Prigatano, Fordyce, Zeiner, et al. (1984), which gives due weight to homemaking and schooling as successful vocations.
Some of the methods designed for supported employment (onsite aid and advocacy, the activity coach) might be extended experimentally to settings in the home and school. The Monthly Employment Ratio (MER), a measure of vocational success developed by the Virginia group (Wehman, Kreutzer, West, et al., 1989), has gained some currency in the field and is worth adopting as a standard outcome measure for supported employment. It could easily be extended into a more general measure, a Monthly Activity Ratio (MAR), based on similar principles of definition, for studies adopting a wider set of criteria of vocational success.
The main focus of the work reviewed here is what may be called outcome evaluation. This strategy is entirely appropriate in medicine when seeking a basis for treatment in evidence, but there might be some utility to other modes of evaluation as well. Observations of process, participant perspectives on the programs (by clients, staff, employers, family, etc.), and assessment of client empowerment could add entirely new dimensions to our knowledge of how programs work. These approaches to "unpacking the black box" of a supported employment program would aim to show how successful programs produce their effects and why unsuccessful programs fail. This is the kind of detailed information we need to improve the design of interventions. It is likely that much remains to be discovered about how individual differences among clients interact with aspects of the programs serving them. Johnson (1987) found that factors like ability to return to one's previous job, being provided a work trial or easier work, and long periods of support were more important in determining successful reemployment than the client's state of deficit. These are typical benefits provided by supported employment. But what makes for easier work, what is support, and what variations in both answer the needs of particular survivors? Many details remain obscure. In many instances, alternate approaches to evaluation will require qualitative methods in combination with the quantitative measures of job retention and success. Models of these other types of evaluation are available from a wide variety of applications, and there is a developing set of methods for applying them (Chelimski and Shadish, 1997). Some work along the suggested lines is already being done--the studies of client characteristics cited in the discussion of independent variables are examples--but an expanded effort to measure the operating details of the programs might be useful in the design and implementation of new or improved programs.
Most of the work found in our search was done on one model of supported employment. The individual placement model is most favored because it is the most flexible and appropriate one for returning individual survivors to their preinjury workplace or to new settings where their particular abilities and deficits allow a successful adjustment. The practical nature of this model of supported employment is its own justification. However, its success has perhaps obscured some good reasons for more work on other models.
Another model which may be worth considering is a revised concept of the work enclave as a work setting designed to fit the abilities and deficits of survivors of TBI, perhaps in company of people with complementary deficits, like other physical disabilities, or with family caregivers. Although a departure from the trend toward integration and normalization of TBI survivors at work, this approach may have certain benefits, especially for the most severely disabled. All models of supported employment were first applied to non-TBI populations, and this modified version of a work enclave is proven effective with some of the same populations served by early programs of individual placement, such as people with chronic mental illness (Fairweather, Sanders, Maynard, et al., 1969).
This different version of the work enclave might offer some of the same resources of natural support as other social settings--like community support groups--which enhance and enable the survivor's life: the camaraderie of fellow survivors and the intrinsic interest and help of family and friends. The combination of work and social relations available in this kind of milieu may have some potential to increase both vocational success and quality of life for survivors of TBI in the same setting and the same program. If effective, it could provide a powerful combination of benefits to relieve that part of the burden of illness in TBI which is linked to vocation and work, providing a personal sense of worth and competence, a sense of belonging and well being, and other psychological states essential to mental health (Pettifer, 1993).
Some long-term functional setbacks and disturbing psychosocial sequelae may not become apparent in survivors of TBI for several years. Some consequences are even preventable, but time is often critical to maximize treatment and forestall secondary effects. One response to issues of how and when to access TBI rehabilitation has been case-management programs designed to monitor survivors and match them with appropriate services. The various impairments that survivors experience often give rise to secondary problems of vocational failure, social isolation, and extended functional dependency that can increase over time at various rates (Brooks, Campsie, Symington, et al., 1986; Goering, Farkas, Lancee, et al., 1988; Kaitaro, Koskinen, and Kaipio, 1995; Olver, Ponsford, and Curran, 1996; Schalen and Nordstrom, 1994; Spatt, Zebenholzer, and Oder, 1997; Van Balen, Mulder, and Keyser, 1996).
TBI impairments present three major survivor- and family-adjustment issues for which case management is a recommended solution. One problem is that survivors may not receive appropriate postacute clinical rehabilitation services, or they may enter programs too early or too late to benefit. There is growing evidence that some effects of TBI can be ameliorated by postacute rehabilitation as late as 10 years postinjury (Hall and Cope, 1995; Johnston and Lewis, 1991; Spatt, Zebenholzer, and Oder, 1997). In spite of this knowledge, survivors and their families may not be entering functional improvement and/or psychosocial support programs at strategic postinjury points. This has been attributed to fragmented responsibility for screening, lack of clarity about how to identify rehabilitation readiness, and lack of accountability among program providers (Greenwood and Brooks, 1994). One reason for the lack of extended rehabilitation could be that programs are either not locally available or are not supported with incoming clients as reported in Europe (McMillan, Morris, Brooks, et al., 1988; Van Balen, Mulder, and Keyser, 1996).
However, other explanations pertain to the nature of the population needs. As the postinjury time increases, the difficulties experienced by survivors of TBI tend to be increasingly subtle and diverse, and informal caregivers fail to recognize and determine their needs. Professionals in primary and specialty care services also can experience confusion about what should be done at which points in the postinjury continuum by which disciplines in which types of service agencies. Unless an advocate is available to maintain interagency relationships and awareness of program improvements and opportunities, it is difficult for survivors of TBI, their families, and their professional caregivers to create a timely recovery agenda and facilitate access.
A second problem for which case management is a projected solution is the relatively low reemployment rate among survivors of TBI. According to Malec, Buffington, Moessner, et al. (1995), the long-term unemployment rate among patients with moderate to severe injuries without vocational intervention is low--about 50 percent--and only one-third resume independent competitive employment. Studies also have shown that the period between brain injury and return to work or initiation of vocational services is long--about 5 to 7 years (Wehman, Sherron, Kregel, et al., 1993; Courtney, 1992; Roessler, Schriner, and Price, 1992).
Without appropriate employment support, survivors may experience additional psychosocial problems because of misinterpretation or lack of understanding about the symptoms. For instance, concentration and memory problems may be perceived as lack of motivation, insensitivity, or mental illness. Most survivors need assistance developing career goals, learning work skills, and seeking and maintaining employment. This is based on evidence of improvement with declining long-term unemployment and underemployment rates being attributed to employment support and work reentry programs for greater numbers of survivors of TBI (Sample and Rowntree, 1995). Because vocational rehabilitation programs that support employment entry or reentry are not a standard feature of TBI clinical rehabilitation programs, case managers or vocational coordinators are considered one means of bridging the agency gap between rehabilitation and reemployment.
A third TBI-related problem for which case management is recommended is the issue of family burden. Studies of head injury effects on family life have shown that cognitive impairments and personality changes are more disruptive than physical disabilities (Cavallo, Kay, and Ezrachi, 1992; Gleckman and Brill, 1995; Godfrey, Knight, and Bishara, 1991; Hendryx, 1989; Kreutzer, Marwitz, and Kepler, 1992; Kwasnica and Heinemann, 1994; Leathem, Heath, and Woolley, 1996; Livingston, 1987), and that parents are better able to withstand such stresses than spouses (Panting and Merry, 1972; Thomsen, 1974). Rosenbaum and Najenson (1976) found that wives of survivors of brain injury experienced more strain and a greater sense of isolation and loneliness than did wives of paraplegics. Others also report evidence of subjective family strain and friction (Brooks, Campsie, Symington, et al, 1986; Weddell, Oddy, and Jenkins, 1980). The burden on families is so widely recognized that programs aimed specifically at support or assistance for the relatives of survivors of TBI are being developed (Carnevale, 1996; Peters, Gluck, and McCormick, 1992; Ragnarsson, Thomas, and Zasler, 1993; Sanguinetti and Catanzaro, 1987). This problem of family difficulty in coping with the effects of TBI merits a broad effort to identify antecedents and effective approaches, including case management.
Case management has emerged as a possible solution because it systematically monitors client needs over time and facilitates access to services in various institutions and programs across communities. Case managers usually serve people with long-term or chronic conditions because they have complex needs and find it difficult to navigate the health and/or social care systems.
According to the Commission for Case Manager Certification (1996), case management is: A means for achieving client wellness and autonomy through advocacy, communication, education, identification of service resources and service facilitation while ensuring that available resources are being used in a timely and cost-effective manner in order to obtain optimum value for both the client and the reimbursement source (p. 2).
The role typically includes admission or intake assessment, care-plan development, service referral, coordination of service details, and collaboration with care providers, informal caregivers, and the client (Goering, Farkas, Lancee, et al., 1988; Goodwin, 1994) and may also include authorization of service payments (Ashley, Krych, Persel, et al., 1994; Evans and Watke, 1995). The domain is to determine service needs and to access service elements with a sequence and timing that will result in desired outcomes for the client and family as well as desired outcomes such as cost control for the service organization.
One characteristic of case management is the adopted mission of the employing organization. Since case managers are found in hospitals, rehabilitation programs, health departments, aging services departments, mental health services, insurance companies, and managed care organizations (Gerber, 1994), the focus can vary from acute-care disposition planning to long-term patient advocacy to service cost control. As the orientation and purpose of case management programs vary, outcomes may reflect the differences. In order for case management interventions to be compared and tested for effectiveness, it is important to define the specific purposes and aspects of case management that are provided.
Case managers also focus on helping clients move across institutional or organizational systems and across provider disciplines. Managing these boundary issues calls for a collaborative approach around a common focus--the client and family. Understanding case management role specifications and the extent of boundary work is also critical for comparing programs and interpreting research that tests case management effects.
Within this context of TBI incidence and long-term effects, problems experienced by clients and their families, and the definition and role of case management, our study was conducted to identify evidence of case management effectiveness. The purpose was to review the literature for controlled clinical studies of the influence of care coordination on targeted outcomes among TBI rehabilitation populations of clients and their families.
Of the 69 articles retrieved for review, 27 were excluded based on the initial exclusion criteria, reducing the total number of articles reviewed to 42. Two investigators read all retrieved articles from the database search, as well as relevant articles found on reference lists of the retrieved articles and those obtained from colleagues, for a total of 73 articles. The only criterion for study selection in this phase was that case management was an independent variable. By mutual agreement three studies were critically analyzed and entered into Tables 1 and 2 to report evidence of case management effectiveness in TBI rehabilitation.
Does the provision of long-term care coordination enhance the general functional status of people with TBI? The search strategies yielded three controlled studies of case management effectiveness in TBI rehabilitation. Two studies compared case management with non-case management, and one study compared two types of case management. Two studies were completed trials (Ashley, Krych, Persel, et al., 1994; Greenwood and Brooks, 1994), and one article (Malec, Buffington, Moessner, et al., 1995) presented preliminary results after 1 year of data collection.
Each selected study focused on a different subpopulation. In two studies, the subjects were homogeneous for level of disability: either moderate disability (mean Disability Rating Scale [DRS] scores of 4.95 and 5.17) (Ashley, Krych, Persel, et al., 1994); or severe disability (mean DRS scores of 16.2 and 18.3, and mean Glasgow Coma Scale [GCS] scores of 6.6 and 5.5) (Greenwood and Brooks, 1994). In the third study, the sample at 1 year consisted of clients with mild injuries (79 percent), as rated with the GCS and moderate or severe injuries (21 percent) Malec, Buffington, Moessner, et al., 1995). Comparison group differences made it necessary to control for aspects that may have affected the outcomes, but no controls were mentioned in the preliminary report by Malec, Buffington, Moessner, et al., 1995.
The studies also tested different models of case management intervention. Ashley, Krych, Persel, et al. (1994) evaluated two insurance-coverage models in which the key aspects were the authority to approve disability payment and rehabilitation service claims, although this was not defined, and differences between the two groups for this characteristic were not reported. Also, the report did not include any other behavioral or role descriptors to compare and contrast the two intervention models. In fact, although a key independent variable was same versus different case managers, it is not clear from the description whether all subjects in one group had the same case manager or whether each subject in the group had one case manager for the entire post-TBI period. Greenwood and Brooks (1994) tested a medical model of case management, defined as clinical needs assessment during acute hospital care, formulation of a proactive rehabilitation plan, and facilitation of rehabilitation cooperation and involvement among patients, family, and professionals.
Malec, Buffington, Moessner, et al. (1995) evaluated a medical-plus-vocational model of case management. They defined it as assessment and rehabilitation planning during acute hospital care for the provision of medical outpatient rehabilitation services and for vocational counseling and planning related to employment services available in the community. Although there were presumably common role behaviors in these two models, there were not enough details offered in the Greenwood and Brooks (1994) report to determine whether the case manager referrals had led to subsequent care coordination by vocational counselors and others. If so, the Greenwood model would have been similar to the Malec model. Only one study identified the discipline or training that the case managers had received (Malec, Buffington, Moessner, et al., 1995). Also, the intervention periods varied by study and by client need, which no doubt influenced the results.
In addition, other design aspects differed among the studies. The data collection points ranged from 1 month to 24 months, with only two studies measuring outcomes at 12 months. In two projects, the research spanned 2 years, but subjects were followed for less than 2 years if they had not entered the study at the beginning. Also, due to the team-oriented nature of case management and the close institutional quarters of the subjects, blind assessments of the subjects were not possible. Therefore, care delivered by the case managers and other team members could have differed among groups and influenced the outcomes. Additionally, there was almost no information about possible cointerventions--such as other service providers--who may have offered care coordination and continuity, and there was very limited information about the other types of rehabilitation services that may have influenced client outcomes.
There are very few studies of the effectiveness of case management. The results of these studies are mixed (Evidence Table for case management, 2). There is evidence from Class III studies that case management improved vocational status. This was associated with the single case manager and insurance approach (Ashley, Krych, Persel, et al., 1994), as well as with the combined nurse and vocational case manager model (Malec, Buffington, Moessner, et al., 1995).
There were conflicting results about the effects of case management on disability or functional status, living status, family impact, and other aspects, and some findings were mentioned in only one study. The clinical trial resulted in no functional status changes among case managed subjects, despite an extended period of rehabilitation (Greenwood and Brooks, 1994). However, when two forms of case management were compared, both the single and multiple case manager/insurance approaches showed significant functional improvements (Ashley, Krych, Persel, et al., 1994).
Findings also conflicted on the effect of case management on subjects' living arrangements. Greater independence was demonstrated with the single case manager and insurance approach (Ashley, Krych, Persel, et al., 1993), while greater dependence was found with the general case manager model (Greenwood and Brooks, 1994). In the only study that measured the effect of case management on families, the result was that families sought more medical care, and they changed their amount of leisure time (although the direction was not identified) (Greenwood and Brooks, 1994). A modest majority of respondents in the Malec, Buffington, Moessner, et al. (1995) study found the case manager helpful, but the report did not mention whether this rating referred to the nurse case manager and/or the vocational case manager. Single-study findings included lower rehabilitation costs and higher disability payments for the single case manager model (Ashley, Krych, Persel, et al., 1993) and identification of unmet case management needs among adolescents, seniors, and alcoholic clients (Malec, Buffington, Moessner, et al., 1995).
From our review we conclude that there is no clear evidence that case management is effective with survivors of TBI and their families, but neither is there clear evidence that it is ineffective. Further research is warranted to resolve this question. It is not possible to directly compare the three studies reviewed because there were almost no similarities in design, sampling, or outcome measures that would provide a basis for comparison. Although all 312 subjects had been diagnosed with brain injury and had evidence of impairment, the samples represent different subpopulations based on injury severity level: moderate, severe, and mixed. For the latter sample, results were not reported by level of injury. Similarly, although there was a controlled intervention of case management provided in each study, there were key differences in the definitions and case management model characteristics. In addition, there were few, if any, specifications about the case managers' training, discipline, experience, and roles. Only one report (Greenwood and Brooks, 1994) mentioned the number of case managers who had provided the intervention (three), and it also was the only report that mentioned the number of clients that were managed by each case manager at one time (20). In no case was there any evidence of reliability or validity testing of the case management approach.
In addition, there are other weaknesses that contribute to the inability to draw conclusions from this small group of studies. One potential source of bias is the lack of control for cointerventions that may have provided service referrals, care continuity, and client and/or family support that simulated case management. This might have occurred, for example, when a study case manager referred the client to another program or service, and it also may have occurred within the family support system. Without controlling for such an effect, it is not possible to attribute any results to formal case management. Another problem is that the studies each provided case management for different amounts of time and at different stages of recovery. Moreover, they utilized different periods of time to measure the outcomes, and the measures did not continue longitudinally for all subjects. This had the statistical effect of reducing the number of subjects who were likely to benefit from the intervention. That is, even if the intervention did have a positive effect, the difference may not have been apparent. Also, because of the team-oriented nature of case management coordination, none of the researchers were able to arrange blind assessments of the subjects. For this reason, it is not possible to know whether there are provider biases associated with care provided for particular subjects or subject groups.
Finally, nothing is known about the quality of the rehabilitation programs associated with the case management models demonstrated in the reviewed studies. Greenwood and Brooks (1994) point out that since the experimental subjects did not progress despite greater rehabilitation service contact time, the cause may have been that the case manager did not have the authority to improve the quality of rehabilitation. Since client and family outcomes may be related only to rehabilitation program benefit, it would be useful to know how to control for rehabilitation program quality to identify confounding factors. Another consideration for possible effect on the targeted outcomes is the ability to access the rehabilitation programs. Since rehabilitation access depends on program availability in the community, economic feasibility for the patient, and the knowledge of others--such as family physicians and emergency care teams--it would be useful to have measures of those environmental conditions as additional outcome analysis controls.
Despite these methodological weaknesses and the incompatible findings, however, there are some observations that can be made from the collective findings of these three studies. First, two of the three studies found significant improvements associated with case management in at least one type of functional outcome (Ashley, Krych, Persel, et al., 1994; Malec, Buffington, Moessner, et al., 1995). This suggests that perhaps the model of case management that was employed in the Greenwood and Brooks (1995) study was simply the wrong model. Second, in the Greenwood and Brooks (1995) study, the dropout rate among subjects without a case manager was higher, which suggests that subjects may have found the service useful in a subjective way. These glimmers of evidence from three controlled studies provide substantive implications for continued research that can improve upon the methods described above.
Research studies in the future need to test for possible effects of case management that have not yet been identified. We believe it is important to conduct clinical trials that specify and test the extent of contact with the client and family, role training and competence, service-approval authority, screening/rescreening frequency, and influence within the rehabilitation community network. Reliability and validity testing also are recommended for measuring case management. In addition, controls should be in place for isolating possible cointerventions that simulate care coordination. The control variables should include postinjury rehabilitation elements such as settings, types of therapies, amount of contact times, goal achievement records, and other aspects that may directly affect client outcomes.
We suggest that there be improved outcome measures used in case management clinical trial studies for TBI subjects. In addition to outcomes of changed client functionality, there should be outcomes of changed family functionality. Since much of case management communication is directed toward helping family members learn what to expect and where to obtain services, relevant outcomes would include family use of community and rehabilitation services and indicators of family assertiveness regarding care expectations. While case management may only indirectly affect a client's functional outcomes such as level of disability, vocational status, and living status, it is possible that case management can directly affect family knowledge of TBI rehabilitation needs and services, level of psychosocial anxiety, and family competency in coping with TBI.
We also recommend separate measures and analyses for subjects with mild, moderate, and severe disability. Greenwood and Brooks (1994) interpreted their findings that more case-managed-group relatives reported a major TBI effect on the family and had more use of prescribed drugs and medical services by attributing the differences to a more severely ill sample in the case-managed group. However, this could not be verified because they had not controlled for severity of illness. Third, if family members were measured at pre- and postintervention points, the case management intervention effects should become more apparent. Finally, for purposes of study comparability, outcomes could be measured at 12-month postinjury intervals.
The purpose of this document is to provide an exhaustive, evidence-based approach to rehabilitation for traumatic brain injury. In order to make this a feasible undertaking, five specific topics were selected from among the many aspects of TBI rehabilitation. These aspects were closely defined and then subjected to rigorous and explicit evidence-based literature review and analysis.
In producing a "conclusions" section to this work, two issues need to be addressed. First, the results of the literature investigations into the five topics should be summarized. Second, their implications should be discussed. Because of the nature of the evidence-based medicine process and the overall weakness of the literature, however, these processes must be undertaken with care.
Although formulated around specific questions, evidence-based medicine is driven by the literature. For instance, the questions that are developed at the outset are almost never directly reflected in any one individual study much less in a body of literature. Therefore, the results of evidence-based medicine efforts will be strongly influenced by the approaches to individual topics taken in the body of relevant literature and by the strength of those studies. Because of these constraints, it is hazardous to separate a synopsis of the conclusions of an evidence-based medicine analysis from the studies that specifically drive those conclusions. Unless there is a large body of Class I literature, separating summary statements from the strength of their supporting evidence vastly increases the risk of their misinterpretation. For that reason, the summary statements contained in this section with respect to the five questions are strictly limited to reflections of the statements made in their individual sections. Readers are strongly encouraged to study those sections prior to interpreting these summary statements.
In addition, because of the overall weakness of the literature as reflected in this work, clinical interpretation is hazardous. It must be remembered that the absence of evidence is not evidence of absence. Although none of the issues involved in TBI rehabilitation that are addressed in this work are supported by Class I evidence, it must be recognized that there also is not a similarly strong body of evidence standing in disproof. Therefore, because something has not been definitively proven as effective must not be interpreted to mean that it does not have clinical utility, should not be continued, or should not be funded. The proper interpretation would be that, in the presence of a need for treatment and the absence of clearly superior alternatives, choices must be made between therapies without proven superiority over others based on clinical pragmatism.
From a funding viewpoint, it must also be recognized that there is a vast difference between making a choice between alternate therapies based on less than optimal evidence and denying an entire category of therapeutic management based on the absence of strong scientific proof of efficacy. The application of evidence-based medicine techniques to the current body of clinical literature over the past several years has effectively raised the scientific bar much higher than ever before. Although it is expected that the new height of the bar will be recognized by clinical researchers and result in significantly better design and more powerful studies in the future, the application of this new degree of rigor to studies done in even the recent past must be seen as an attempt to improve medicine, not paralyze it.
One small, retrospective, observational study from a single rehabilitation facility supports an association between the acute institution of formalized, multidisciplinary, physiatrist-driven TBI rehabilitation and decreased LOS (acute hospital and acute rehabilitation) and some measures of short-term physiologic (non-cognitive) patient outcome. The level of evidence is Class III. This study concerned patients with severe brain injury (GCS 3-8). There is no evidence from comparative studies for or against early rehabilitation in patients with mild and moderate injury.
Deriving clinical implications from the single Class III study that directly addresses this question must be done with trepidation. It is generally felt that the application of modalities such as physical therapy as early as possible following TBI is beneficial. In addition, the transition from acute stay at the trauma hospital to a rehabilitation facility for severe TBI patients is almost always driven by issues that are peripheral to the proper timing of rehabilitation efforts (e.g., systemic complications, bed availability, etc.). Since the one study did suggest that the institution of formalized, multidisciplinary, physiatrist-driven TBI rehabilitation efforts early in the posttraumatic period was favorably associated with short-term outcome and logistics, it would seem reasonable, based on the present body of literature, to include a physiatrist in the acute care team in as expedient a fashion as possible.
When measured as the hours of application of individual or group therapies, there is no indication that the intensity of acute-inpatient TBI rehabilitation is related to outcome. Because of methodological weaknesses, however, previous studies are likely to have missed a significant relationship if one exists (a Type II error). These studies contained insufficient information about severity of injury and baseline function to ensure the comparability of the compared groups. These studies also did not consider the quality of individual treatments, their lack of autonomy in the cognitive realm, and the delivery milieu. One or more of these factors might affect the outcome of care more than the time spent in each modality. Therefore, future research into efficacy of acute inpatient TBI rehabilitation must more adequately measure such factors and include them in their predictive models. Future studies also must employ a wider spectrum of outcome measures including measurement of outcomes for a longer period after discharge. Such an analysis would be an ideal application of a universal uniform data set.
With regard to the clinical aspect, the evidence does not support equating different systems of TBI rehabilitation delivery based on equivalent times of patient exposure to various therapeutic modalities. For example, this analysis would not support the assumption that patient benefit would be equal if an equal time spectrum of rehabilitation therapies were delivered at a rehabilitation center as compared with a skilled nursing facility. More detailed analysis of factors involved in predicting response to rehabilitation modalities must be considered in approaching such questions.
Additionally, mandating a minimum number of hours of applied therapy for all TBI patients is not supported by the present state of scientific knowledge. The issues of how much intervention optimizes recovery in a given type of patient remains inadequately studied. It is certainly reasonable to avoid situations in which patients do not receive potentially beneficial treatment. Based on the above studies, however, defining a minimum rehabilitation program in terms of time of applied therapy is not likely to optimize either therapist time or patient recovery. It is probable that a specific basic program will have to be related to individual patient groups. Developing such algorithms requires future research.
Many people who suffer TBI do not enter acute inpatient rehabilitation. Only one study of the effectiveness of inpatient rehabilitation included a comparison group of patients who did not undergo inpatient rehabilitation. Future studies should compare acute, inpatient rehabilitation with commonly used alternatives to inpatient rehabilitation, such as care in a well-staffed, skilled nursing facility or in less intense variations of acute rehabilitation. Very little is known about the outcomes of TBI in these settings.
One small randomized controlled trial (Class I) and one observational study (Class III) provide evidence of the direct effects of compensatory cognitive devices (notebooks, wristwatch alarms, programmed reminder devices) on the reduction of everyday memory failures for people with TBI. A second randomized controlled trial provides evidence that compensatory cognitive rehabilitation reduces anxiety and improves self-concept and interpersonal relationships for people with TBI. The level of evidence is Class II[a].
Two small randomized controlled trials (Class I) provide limited evidence that practice and computer-aided cognitive rehabilitation improve performance on laboratory-based measures of immediate recall. No studies evaluated the link between such cognitive tests and health outcomes, and the associations between performance on cognitive tests and employment in the literature were inconsistent.
Current practice in cognitive rehabilitation lacks a firm basis in experimental clinical studies. It is unlikely that the studies we reviewed, designed to address effectiveness, accurately describe the totality of techniques, stimulation, and human effort and ingenuity that constitute cognitive rehabilitation programs, particularly if the programs are multi- or transdisciplinary. Therapists observe that their patients improve; what is causing the improvements is not understood. In making decisions about the course of treatment, clinicians are compelled to follow their experiences and observations until strong research designs provide evidence from which guidelines and standards can be derived.
There is some Class II evidence that supported employment can improve the vocational outcomes of survivors of TBI. Most of the evidence on the effects of supported employment comes from two programs of research, each of which used different experimental designs and different models of supported employment. Both designs used prospective data collection, but one compared the treatment group with an independent control, while the other was a case control study comparing preinjury employment with postinjury employment without and then with supported employment. The findings have not been replicated at other centers, so the results cannot be generalized to the general population of survivors of TBI. Most studies of supported employment in TBI research are of the individual placement model, but some evidence also supports the use of the apprenticeship model.
The evidence for improvement of vocational outcomes with supported employment is sufficient to warrant its use in practice while further research continues. However, much remains unknown about the amount of improvement that is actually gained by these programs and which components of the programs contribute most to the improved outcomes. It also may be important to explore other models of supported employment, like the apprenticeship model or some variations of the work enclave model.
Very few studies of the effectiveness of case management have been done, and results have been mixed. The clearest demonstration of improvement due to case management is in vocational status, where at least two studies, using different models of case management, showed similar improvements. One of these two programs showed superior results when a single case manager administered all the insurance benefits of each patient; the other showed results in the same direction using a combination of nurse and vocational case manager to select and time the interventions. There were conflicting results on other effects of case management, including disability or functional status, living status, and effects on the family, and some outcomes were mentioned in only one study. The clinical trial, using separate hospital systems randomly assigned to a case management condition, showed that there were no functional status changes among case management participants, despite an extended period of rehabilitation and followup. But, when two forms of case management were compared, both the single and multiple case manager/insurance models showed significant functional improvements.
Although the present evidence is mixed, it seems warranted to continue the use of several case management models to select and time interventions in cases of TBI, and it also may be of benefit to survivors to have the advocacy by the case manager in finding and obtaining treatments. There is a certain face validity to the basic idea of case management, which is simply a matter of careful planning of the choice, sequence, and timing of interventions, and some variation of it is really a standard component of most clinical practice. Also, there probably is some value to the person with TBI of an advocate able to obtain benefits that otherwise would be missed by an unaided survivor. The extent of the benefit of case management, however, remains undemonstrated, and more studies using control groups would be very beneficial in clarifying the actual improvement in outcomes due to case management. It also is unclear whether some models of case management are better than others and for what kinds of clients they might be best suited. These questions contribute to the agenda for future research.
Due to the methods through which the above five topics have been approached in the literature and the relative absence of powerful studies in these areas, the conclusions reached by this evidence-based approach and the clinical implications drawn therefrom are extremely limited. As a direct result, the utility of this document in driving profound alterations in TBI rehabilitation based on the scientific literature is very restricted. Because this report is the product of an exhaustive review of the literature in these five areas, however, we are in an ideal position to be able to summarize the shortcomings of the studies in these fields and to make generalizable recommendations regarding how future efforts could be improved. Since the five topics addressed in this work run the temporal gamut from acute care through long-term survival, this document also serves as an ideal conduit for suggesting the means for optimizing continuity and consistency of research efforts across the spectrum of recovery from TBI. Because the ability to suggest improvements in research efforts in a knowledgeable fashion is probably the most valuable result of this work, special attention was directed to this area. For further information, readers are directed to the analyses of research shortcomings and sets of recommendations presented in the Aspen Consensus Conference proceedings (Chesnut, Alexander, Antoinette, et al., forthcoming).
ADL: Activities of daily living
AHCPR: Agency for Health Care Policy and Research
AIS: Abbreviated injury score
ANCOVA: Analysis of covariance
BVRT: Benton Visual Retention Test
CACR: Computer-aided cognitive rehabilitation
CCR: Compensatory cognitive rehabiliation
CFT: Complex Figure Test
CIQ: Community Integration Questionnaire
CT: Computerized tomography
D/C: Discharge
DRS: Disability rating scale
EMF: Everyday memory failure
EPC: Evidence-based Practice Center
FAM: Functional Adaptability Measure
FIM: Functional Independence Measure
GCS: Glasgow Coma Scale
GOS: Glasgow Outcomes Scale
HCFA: Health Care Financing Administration
ICP: Intracranial pressure
ILP: Independent living programs
ISS: Injury severity scale
KAS: Katz Adjustment Scale
LOS: Length of stay
MANOVA: Multivariable analysis of variance
MAR: Monthly activity ratio
MER: Monthly employment ratio
MMPI: Minnesota Multiphasic Personality Inventory
OHSU: Oregon Health Sciences University
OT: Occupational therapy
PAI: Portland Adaptability Inventory
PASAT: Paced Auditory Serial Addition Task
PT: Physical therapy
PTA: Post-traumatic amnesia
RBMT: Rivermead Behavioral Memory Test
RCR: Restorative cognitive rehabilitation
RCT: Randomized, controlled trial
RKE: Rabideau Kitchen Evaluation
RLA: Ranch Los Amigo
RLAS: Ruff Language Assessment Scale
RT: Reaction time
SRT: Selective Reminding Test
ST: Speech therapy
TBI: Traumatic brain injury
TCDB: Traumatic Coma Data Bank
TEP: Transitional employment program
TLT: Trail Learning Test
VerPa: Verbal Paired Associated Task
VisPa: Visual Paired Associates Task
WAIS: Wechser Adult Intelligence Scale
WMS: Wechser Memory Scale
WRP: Work reentry program
Question 1
1. Does the application of early, interdisciplinary rehabilitation improve outcomes for people with traumatic brain injury?
Rationale:
The use of interdisciplinary rehabilitation varies in when it is applied.
The purpose of this question is to find out if there is evidence that the application of this intervention during treatment in the acute care hospital improves outcomes.
Definitions:
Early applies to the phase of treatment after discharge from the emergency department and prior to discharge from the acute care hospital.
Interdisciplinary rehabilitation is an intervention that utilizes a variety of methods, usually including but not limited to physical therapy, occupational therapy, and speech therapy.
Patient population:
People who sustained traumatic brain injury between the ages of 18 and 65 years whose injury severity warranted admission to a hospital emergency department and subsequent transfer to acute care.
Patient characteristics:
Age, severity of injury, pre-morbid data, mechanism of injury (kind of trauma and intracranial diagnosis), and functional status measure. Measures of injury severity include Glasgow Coma Scale Score and multiple injuries.
Studies must include or measure:
Age
Glasgow Coma Scale Score
Severity of injury
Multiple injuries
Pre-morbid data
Mechanism of injury (kind of trauma)
Intracranial diagnosis
Functional status measure
Outcome measures:
Presence or absence of complications (i.e., skin problems, pneumonia)
Length of stay in hospital.
Immediate care costs and long-term financial burden.
Health status at discharge from the acute care hospital (ADLs, locomotion, and short-term functional status measure such as Disability Rating Scale).
Long-term measure of impairment (loss or abnormality of psychological, physiological, or anatomical structure or function).
Long-term measure of disability (restriction or lack [resulting from an impairment] of ability to perform an activity in the manner or within the range considered normal for a human being).
Question 2
2. Does the intensity of inpatient rehabilitation affect outcomes for people with traumatic brain injury?
Rationale:
The application of inpatient rehabilitation varies in intensity.
The purpose of this question is to find out if there is evidence that a particular level of intensity of inpatient rehabilitation optimizes outcomes.
Definitions:
Inpatient rehabilitation applies to the phase of treatment after discharge from the acute care hospital into an inpatient rehabilitation facility.
Intensity--Levels of the intervention vary in intensity based on:
Whether the intervention was directed and managed by a physiatrist.
Number, kinds, and frequency of methods applied.
Patient population:
People who sustained traumatic brain injury between the ages of 18 and 65 years whose injury severity warranted admission to a hospital emergency department, transfer to acute care, and subsequent transfer to inpatient rehabilitation.
Patient characteristics:
Age, severity of injury, pre-morbid data, mechanism of injury (kind of trauma and intracranial diagnosis) and functional status measure. Measures of injury severity include Glasgow Coma Scale Score and multiple injuries.
Studies must include or measure:
Age
Glasgow Coma Scale Score
Severity of injury
Multiple injuries
Pre-morbid data
Mechanism of injury (kind of trauma)
Intracranial diagnosis
Functional status measure
Outcome measures:
Length of stay in rehabilitation facility.
Immediate care costs and long-term financial burden.
Health status at discharge from inpatient rehabilitation (ADLs, locomotion, and short-term functional status measure such as Disability Rating Scale).
Long-term measure of impairment (loss or abnormality of psychological, physiological, or anatomical structure or function).
Long-term measure of disability (restriction or lack [resulting from an impairment] of ability to perform an activity in the manner or within the range considered normal for a human being).
Independence, relationships, family life, satisfaction.
Question 3
3. Does the application of compensatory cognitive rehabilitation enhance outcomes for people who sustain traumatic brain injury?
Rationale:
The efficacy of cognitive rehabilitation is being questioned. In addition, the application of the intervention may be based on patient resources; the availability may be based on regional differences.
The purpose of this question is to find out if there is evidence that compensatory cognitive rehabilitation is an effective intervention.
Definitions:
Cognitive rehabilitation -- Treatment to increase or improve the capacity to process and use incoming information so as to allow increased functioning in everyday life.
Focus is correcting deficits in memory, concentration and attention, perception, learning, planning, sequencing, and judgment. The broad definition includes both methods to restore cognitive function and compensatory techniques, such as use of memory aids.
Patient population:
People who sustained traumatic brain injury between the ages of 18 and 65 years whose functional status level allows for employment and/or community integration, but who require an intervention to facilitate success.
Patient characteristics:
Age, severity of injury, pre-morbid data, mechanism of injury (kind of trauma and intracranial diagnosis), application and methods of inpatient rehabilitation, and chronicity at time of entry to out-patient program.
Outcome measures:
ADLs.
Return to work/school, maintenance of job/school, long-term financial burden.
Long-term measure of disability (restriction or lack [resulting from an impairment] of ability to perform an activity in the manner or within the range considered normal for a human being).
Long-term measure of impairment (loss or abnormality of psychological, physiological, or anatomical structure or function).
Independence, relationships, family life, satisfaction.
Question 4
4. Does the application of supported employment enhance outcomes for people with traumatic brain injury?
Rationale:
For people who have sustained traumatic brain injury, the ability to maintain employment may be compromised by cognitive deficits and behaviors not normally accepted in the workplace.
The purpose of this question is to find out if there is evidence that the intervention of supported employment operates to facilitate job maintenance and success.
Definitions:
Supported employment -- An intervention in which the occupational tasks and environment are modified specific to the needs of the patient, where training is modified according to the patient's deficits, and where responsibility for attendance and performance at a job are shared by a professional.
Patient population:
People who sustained traumatic brain injury between the ages of 18 and 65 years whose functional status level allows for employment, but who require an intervention to facilitate success.
Patient characteristics:
Age, severity of injury, pre-morbid data, mechanism of injury (kind of trauma and intracranial diagnosis), application and methods of inpatient rehabilitation, and chronicity at time of entry to supported employment program.
Outcome measures:
Job maintenance.
Job success.
Efficiency.
Types of work held relative to that of pre-injury.
Income level relative to that of pre-injury.
Immediate care costs and long-term financial burden.
Independence, relationships, family life, satisfaction.
Question 5
5. Does the provision of long-term care coordination enhance the general functional status of people with traumatic brain injury? What is the cost-effectiveness of the provision of this intervention?
Rationale:
As people with traumatic brain injury move through their recovery process, they may be particularly vulnerable during periods of transition.
Case management by a certified individual may not always be available or optimal; a family member may provide the service.
This question asks if there are benefits to continuity of care, and if so, what the costs are relative to those benefits.
Definitions:
Care coordination -- Service provided by someone other than the patient throughout phases of recovery that:
considers alternative interventions and venues relevant to the patient's needs,
considers available resources and/or identifies and secures new resources to fund the interventions,
provides information to patient and family about alternatives,
facilitates selection and implementation of the intervention that best represents the needs and desires of the patient and family, and
monitors and communicates about the progress of the patient and family while the patient is participating in the intervention.
A care coordinator may be a private contractor, representative of an agency, family member or friend, medical professional, or rehabilitation professional.
Patient population:
People with traumatic brain injury between the ages of 18 and 65 years.
Patient characteristics:
Age, severity of injury, pre-morbid data, mechanism of injury (kind of trauma and intracranial diagnosis, application and methods of inpatient and/or out-patient rehabilitation. Identification of care coordinator.
Outcome measures:
Return to work/school, maintenance of job/school, long-term financial burden.
Long-term measure of disability (restriction or lack [resulting from an impairment] of ability to perform an activity in the manner or within the range considered normal for a human being).
Long-term measure of impairment (loss or abnormality of psychological, physiological, or anatomical structure or function).
Independence, relationships, family life, satisfaction.
1. MEDLINE search string
MEDLINE Initial Strategy (Identical for all questions) - 1993 to November 1997
Explode Head Injuries/Rehab
Explode Head/Injury
rh.fs.
2 and 3
Head injur $.tw
Brain injur $.tw
5 or 6
7 and 3
1 or 4 or 8
MEDLINE Questions 1 and 2 Strategy
Limit 9 to human
Exp hospitals/
Accute.tw.
Exp intensive care units
Early.tw.
Length of stay/
Exp emergency medical services/
Emergency medicine/
Exp hospitalization/
Interdisciplinary rehabil$.tw.
Speech therapy/
Physiatry.tw.
Exp physical therapy/
Physical therapy department, hospital/
Occupational therapy/
Occupational therapy department, hospital/
Exp rehabilitation/
Exp rehabilitation centers/
Rehabilitation.tw.
19 or 20 or 21 or 22 or 23 or 24 or 25 or 26 or 27 or 28
Exp head injuries/
29 and 30
10 or 31
11 or 12 or 13 or 14 or 15 or 16 or 17 or 18 or 19 or 20 or 21 or 22 or 23 or 24 or 25 or 26 or 27 or 28
32 and 33
Exp clinical trials
32 and 35
From 36 keep 1-4
From 34 keep 1-5, 8-12, 14, 18, 20-22, 25, 27-28
MEDLINE Question 3 Strategy
Limit 9 to human
Exp cognition/
Exp cognition disorders/
Cognit$.tw
Exp memory/
Exp memory disorders/
Attention/
exp perception/
exp learning
exp learning disorders/
judgment/
11 or 12 or 13 or 14 or 15 or 16 or 17 or 18 or 19
10 and 21
from 22 keep 2-3, 8, 11, 14-15, 17-18, 20-21, 23
MEDLINE Question 4 Strategy
Limit 9 to human
Exp employment/
Work capacity evaluation/
Exp work/
absenteeism/
Employment.tw.
Employed.tw.
Vocational education/
Exp rehabilitation, vocational/
sheltered workshops/
11 or 12 or 13 or 14 or 15 or 16 or 17 or 18 or 19
10 and 20
from 21 keep 1-10, 12-13, 15-16, 18-26, 28-38, 40
exp brain injuries/
20 and 23
24 not 21
limit 25 to human
from 26 keep 7-9, 19, 22, 29
Medline Question 5 Strategy
case management/
exp home nursing/
forecasting/
follow-up studies/
long term.tw.
longterm.tw.
social work/
10 or 11 or 12 or 13 or 14 or 15 or 16
exp *brain injuries/
9 or 18
17 and 19
limit 20 to human
10 or 11 or 16
22 and 21
from 23 keep 1-2, 4-8
21 not 23
from 25 keep 5-8, 11-13, 15, 20, 23, 32, 35-36, 38
2. HealthSTAR search strings
HealthSTAR strategy (identical for all questions) 1993 to November 1997
Explode Head Injuries/Rehab
Explode Head/Injury
rh.fs.
2 and 3
Head injur$.tw
Brain injur $.tw
5 or 6
7 and 3
1 or 4 or 8
3. CINAHL search strings
CINAHL general search strategy (all questions) 1982 to October 1997
american journal of occupational therapy.jn
archives of physical medicine and rehabilitat
clinical rehabilitation.jn.
disability & rehabilitation.jn.
international journal of rehabilitation res
journal of rehabilitation research & develo
physical therapy.jn.
quality of life research.jn.
rehabiliation nursing.jn.
rehabiliation.jn.
9 or 10
scandinavian journal of rehabiliation medi
scandinavian journal of rehabiliation medi
1 or 2 or 3 or 4 or 5 or 6 or 7 or 8 or 9 or 10
exp brain injuries/
brain injur$.tw.
15 or 16
exp rehabiliation/
rh.fs.
18 or 19
17 and 30
21 not 14
from 22 keep 1-7, 9-10, 12-13, 15-20, 22-24, 26
from 22 keep 6, 12-13, 15-16, 20-22, 24, 29-30, 33
23 or 24
brain injury.jn.
22 not 26
25 not 26
27 not 28
from 29 keep 6-7, 14, 17, 20, 22, 25, 32-33, 35-36
28 or 30
22 not 31
4. PyschInfo search string
PsycInfo search strategy (all questions) 1982 to October 1997
exp brain damage/
exp head injuries/
2 not 1
brain.tw.
3 and 4
1 or 5
exp cognitive rehabilitation
exp rehabilitation
exp rehabilitation centers/
exp vocational rehabilitation/
exp employment status/
exp case management/
clinical trials.tw.
7 or 8 or 9 or 10 or 11 or 12 or 13
6 and 14
5. Current Contents search string
Current Contents search strategy ( all questions) Week 01, 1998 to Week 21, 1998
head injur$.ab,ti,kw,kp.
Brain injur$.ab,ti.kw,kp.
1 or 2

Abstraction Instrument, items 1-17

Abstraction Instrument, items 18-28

Abstraction Instrument, items 29-37

Abstraction Instrument, Question #1: Does the Application of Early,
Interdisciplinary Rehabilitation Improve Outcomes for Persons With Traumatic Brain
Injury? (items 1-7)

Abstraction Instrument, Question 1, items 8-12

Abstraction Instrument,
Question #2: Does the Intensity of In-Patient Rehabilitation Affect Outcomes for
Persons With Traumatic Brain Injury? (items 1-5)

Abstraction Instrument, Question 2, items 6-11

Abstraction Instrument, Question #3: Does the Application of Compensatory
Cognitive Rehabilition Enhance Outcomes for Persons Who Sustain Traumatic Brain Injury
(items 1-8)

Abstraction Instrument, Question 3, items 9-13

Abstraction Instrument, Question #4: Does the Application of supported Employment
Enhance Outcomes for Persons With Traumatic Brain Injury? (items 1-8)

Abstraction Instrument, Question 4, items 9-11

Abstraction Instrument, Question #5: Does the Provision of Long-Term Care
Coordination Enhance the General Functional Status of Persons With Traumatic Brain
Injury? What is the Cost-Effectiveness of the Provision of this Intervention? (items 1-9

Abstraction Instrument, Question 5 item 10

Principal Investigator
Randall M. Chesnut, M.D.
Associate Professor of Neurological Surgery
Director, Neurotrauma and Neurosurgical Critical Care
Oregon Health Sciences University
Task Order Manager
Nancy Carney, Ph.D.
Division of Medical Informatics and Outcomes Research
Oregon Health Sciences University
N. Clay Mann, Ph.D.
Assistant Professor of Emergency Medicine
Oregon Health Sciences University
Hugo Maynard, Ph.D.
Professor of Psychology
Portland State University
Portland, OR
Patricia Patterson, Ph.D.
Assistant Professor of Nursing and Medical Informatics
and Outcomes Research
Oregon Health Sciences University
Petronella Davies, M.S.
Reference Librarian
Oregon Health Sciences University
Cynthia Davis-O'Reilly
Division of Medical Informatics and Outcomes Research
Oregon Health Sciences University
Mark C. Hornbrook, Ph.D.
Program Director
Health Services, Social and Economics Studies
Kaiser Permanente Center for Health Research
Susan Mahon, M.P.H.
Research Associate
Division of Medical Informatics and Outcomes Research
Oregon Health Sciences University
Martie Sucec
Senior Technical Writer
Kaiser Permanente Center for Health Research
James Wallace
Operations Director, Outcomes Research
Division of Medical Informatics and Outcomes Research
Oregon Health Sciences University
Melanie Zimmer-Gembeck, Ph.D.
Senior Data Analyst
Office of Planning and Development
Multnomah County Health Department
Mark Helfand, M.D., M.P.H.
Director, Evidence-Based Practice Center
Associate Professor of Internal Medicine and Medical Informatics and Outcomes Research
Oregon Health Sciences University
Kathryn Pyle Krages, A.M.L.S., M.A.
Administrator, Evidence-Based Practice Center
Division of Medical Informatics and Outcomes Research
Oregon Health Sciences University
Bryna Helfter, M.A., C.T.R.S.
Director, Technical Assistance Center
Traumatic Brain Injury State Demonstration Grant Program of Maryland
James Kelly, M.D.
Director, Brain Injury Program
Rehabilitation Institute of Chicago
Jeffrey Kreutzer, Ph.D.
Director of Rehabilitation Psychology and Neuropsychology
Medical College of Virginia
Nathan Zasler, M.D.
Executive Medical Director, National NeuroRehabilitation Consortium, Inc.
Medical Director, Concussion Care Centre of Virginia
Robert Brown
Survivor
Brain Injury Support Group of Portland
Carol Christofero-Snider
Spouse of Survivor
Brain Injury Support Group of Portland
Danielle Erb, M.D.
Rehabilitation Medicine Associates
Molly Hoeflich, M.D.
Physiatrist
Daniel Irwin
Vocational Rehabilitation Division
Oregon Department of Human Services
Donald Lange, Ph.D.
Neuropsychologist
Hugo Maynard, Ph.D.
Professor of Psychology
Portland State University
Aimee Mooney, M.S.
Rehabilitation Program Coordinator
Legacy Rehabilitation Services Community Re-entry Service
Meg Munger, R.N., M.S.
Rehabilitation Program Coordinator
Kaiser Permanente
Brian Andrews, M.D., F.A.C.S.
San Francisco, CA
Representing the American Association of Neurological Surgeons
Harriet Udin Aronow, Ph.D.
Associate Director of Research
Casa Colina Hospital for Rehabilitative Medicine
Los Angeles, CA
Dawn Bunting, M.S.N., R.N.
Plantsville, CT
Representing the Association of Rehabilitation Nurses
Consensus Development Conference Panel for Rehabilitation of Persons with Traumatic Brain Injury
c/o Judith M. Whalen
Associate Director for Science Policy, Analysis and Communication
National Institute of Child Health and Human Development
Bethesda, MD
Patricia Goodall
VA Department of Rehabilitative Services
Richmond, VA
Representing the Association for Persons in Supported Employment
Richard J. Greenwood, M.D., F.R.C.P.
Regional Neurological Rehabilitation Unit
Homerton Hospital
London, England
Candace F. Gustafson, R.N.
Burlington, MA
Representing the Development Conference Panel for Rehabilitation of Persons with Traumatic Brain Injury
Allen Heinemann, Ph.D.
Rehabilitation Institute of Chicago
Chicago, IL
Jess F. Kraus, Ph.D.
Southern California Injury Prevention Research Center
UCLA School of Public Health
Los Angeles, CA
Representing the Brain Injury Association
Mark Melgard, M.D.
Workers Compensation Division
Department of Consumer & Business Services
State of Oregon
Salem, OR
Anthony Morgan, M.D., F.A.C.S.
Chief of Trauma Services
Saint Francis Hospital and Medical Center
Hartford, CT
Thomas Novack, Ph.D.
Spain Rehabilitation Center
Birmingham, AL
Kristjan T. Ragnarsson, M.D.
Department of Rehabilitation Medicine
Mount Sinai Medical Center
New York, NY
Representing the Consensus Development Conference Panel for Rehabilitation of Persons with Traumatic Brain Injury
Cheryl Ramandan-Jradi
Mercer Island, WA
Representing the American Occupational Therapy Association
Ronald Ruff, Ph.D.
San Francisco Neuropsychology Associates
San Francisco, CA
Barbara Scheffel, R.N.
Scheffel Associates, Inc.
Bedminster, NJ
Representing the Case Management Association of America
Maureen Schmitter-Edgecombe, Ph.D.
Department of Psychology
Washington State University
Pullman, WA
Marymargaret Sharp-Pucci, Ed.D., M.P.H.
Technology Evaluation Center
Blue Cross Blue Shield Association
Chicago, IL
McKay Moore Sohlberg, Ph.D.
Department of Communications Disorders & Sciences
University of Oregon
Eugene, OR
Linda Toms Barker
Berkeley Planning Associates
Oakland, CA
Charles Turkelson, Ph.D.
ECRI
Plymouth Meeting, PA
Dennis A. Turner, M.D.
Division of Neurosurgery
Duke University Medical Center
Durham, NC
Professor Barbara Wilson
Medical Research Council
Applied Psychology Unit
Addenbrooke's Hospital
Cambridge, England
Mark Ylvisaker, Ph.D.
Department of Communications Disorders
College of Saint Rose
Schenectady, NY
Nathan Zasler, M.D.
Executive Medical Director, NationalNeuroRehabilitation Consortium, Inc.
Medical Director, Concussion Care Centre of Virginia
Glen Allen, VA
Free Full text in PMC]
Free Full text in PMC]
Free Full text in PMC]
Free Full text in PMC]
Free Full text in PMC] [PubMed]Use of language in reference to people with TBI is based on a survey of current usage. "Survivor" isused through the course of a person's life. "Patient" is used when the person is an inpatient. "Client" is used in general outside the patient setting. Otherwise,"a person (or people) with TBI" is the preferred term.