• We are sorry, but NCBI web applications do not support your browser and may not function properly. More information
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptNIH Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
Drug Alcohol Depend. Author manuscript; available in PMC Jul 18, 2007.
Published in final edited form as:
PMCID: PMC1924645
NIHMSID: NIHMS22097

Customizing Treatment to the Patient: Adaptive Treatment Strategies

Much research has documented both the wide heterogeneity in patient response in the treatment of drug dependence (Crits-Christoph et al., 1999) and the wide variety of available treatment options. Because of patient heterogeneity clinicians often must adapt the treatment to the patient to obtain an acute response. In practice adaptation is often achieved by implementing treatments (or variations of one treatment) sequentially in a trial and error fashion until a response is obtained. Even once an acute response has been achieved, there remains a high risk of relapse both during and following treatment (McLellan et al., 2000; McLellan, 2002; McKay et al., 2004), requiring trying more treatment alternatives. Taken together, these realities imply that in both the acute and long term treatment of drug dependence, clinicians must continually adapt and readapt the treatment to the patient.

The confluence of the above disorder characteristics with the availability of multiple treatments and multiple variations of each treatment motivates the construction of adaptive treatment strategies (Lavori and Dawson, 1998, 2004; Lavori, et al. 2000; Murphy and McKay, 2003; Collins, et al. 2004). These strategies individualize treatment via decision rules that recommend when and for whom the treatment should change; frequently they incorporate a sequence of treatments. The decision rules take as input patient characteristics and outcomes collected during treatment, such as patient risk factors, patient response, and patient adherence, and provide as output a treatment recommendation. The adaptive treatment strategy concept underlies a number of treatment approaches used in substance abuse and related fields; examples include the stepped care models in substance abuse (Sobel and Sobel, 2000; Brooner and Kidorf, 2002; McKay, 2005), structured treatment interruptions in AIDS (Lisziewicz and Lori, 2002) and the algorithms used in the treatment of depressive, bipolar and schizophrenicdisorders (Miller et al., 1999; Rush et al., 1999).

The purpose of this supplemental issue is to share with readers of Drug and Alcohol Dependence recent research on both the methodology and implementation of adaptive treatment strategies for treatment of drug abuse and related disorders. The articles in this issue by Marlow et al. and Brooner et al. provide evaluations of promising adaptive treatment strategies. In the intervention evaluated by Marlowe et al., level of judicial supervision is matched to the risk level of the drug offender. In addition to illustrating the promise of this particular adaptive intervention, Marlowe et al. raise an important issue for consideration. Even though a particular risk factor (e.g. young male) may correlate with treatment outcomes, this does not imply that this risk factor is useful for deciding which treatment is best for each individual. Using a risk factor to adapt the treatment to an individual requires that the risk factor interact with the treatments. This interaction must be sufficiently strong so that for some values of the risk factor one treatment produces better outcomes, whereas for other values of the risk factor a different treatment is better.

Brooner et al. compare two adaptive treatment strategies (in addition to a “treatment-as-usual” condition and a contingent voucher condition). Depending on the particular adaptive treatment condition, the intensity of the counseling and the use of both positive and negative behavioral contingencies is adapted and then readapted to the patient’s symptoms as measured by urine tests and adherence (at counseling sessions). A crucial characteristic of the interventions discussed by both Marlowe et al. and Brooner et al. is that the decision rules are explicit and operationalized. Both articles provide their decision rules. The intervention evaluated by Marlowe et al. uses a very simple one-time matching of judicial supervision level to offender risk level. In contrast, Brooner et al. use a sequence of decision rules to decide when and if an individual will move from one treatment step to the next. Each individual is provided a sequence of adapted variations in treatment, adapted mainly via the number and type of assigned counseling sessions.

Despite the activity in evaluating adaptive treatment strategies, the development of data collection and analytic methods that directly inform the construction of adaptive treatment strategies lags behind. Four articles in this supplemental issue address these topics. Murphy et al. discuss a promising clinical trial design: the sequential, multiple assignment, randomized trial (SMART). In SMART, subjects are randomized more than one time. A number of SMART trials have been, or are being, conducted. These include the CATIE trial for antipsychotic medications in patients with Alzheimer’s (Schneider et al., 2001), the STAR*D trial for depression treatment (Rush et al., 2003; Lavori et al, 2001) and trials in cancer (Stone, et al. 1995; Tummarello, et al. 1997). Currently there are a number of ongoing SMART studies including a trial concerning alcohol dependence by David Oslin at the University of Pennsylvania, a trial concerning attention deficit disorder by William Pelham, at the State University of New York, Buffalo and numerous trials in the design stage concerning cancer by Peter Thall at the MD Anderson Cancer Center.

The Rivera et al., Rosenberg et al. and Pineau et al. articles present data analysis methods for constructing adaptive treatment strategies. The methods discussed by Rivera et al. and Rosenberg et al. stem from the field of “control theory.” Not only is control theory is an active area of research in engineering, operations research and applied mathematics, as Rivera et al. pointed out it figures prominently in everyday life in useful inventions such as cruise control in automobiles and insulin pumps. For example, control theory is used to construct the decision rules that ensure that automobiles move at the desired speed accommodating the presence of hills and valleys and that patients are provided the correct amount of insulin tailored to the variation in the individual’s food intake throughout the day.

An important message, emphasized in the Rivera et al. article, is that methods in control theory are designed to transfer variance in outcomes to variance in treatment. Translated to clinical science, this means that these methods seek to reduce the variance in outcomes (e.g. the heterogeneity in response both across patients and within a patient across time) by introducing variance in treatment (e.g. tailoring the treatment to each patient and re-tailoring throughout the course of the disorder). Methods in control theory operationalize this crucial clinical insight and thereby seek to make adaptive interventions work better.

Another important message in both the Rivera et al. and Rosenberg et al. articles concerns the utility of computer simulations. The computer simulations depend on a mechanistic, dynamic model of how patient characteristics and outcomes to past treatment interact with present treatment to result in subsequent patient outcomes. These models incorporate both time-varying outcomes and treatments. Rosenberg et al. provide an overview of a dynamic model of the time-varying relationship between viral load, CD4 T cell count and treatment of HIV. Given a dynamic model one can, via simulation, create a population of virtual patients. A host of different adaptive treatment strategies can then be compared and contrasted using this population. This process results in one or more adaptive treatment strategy proposals that can be evaluated in clinical trials. Used effectively, the simulation enables comparison of many different adaptive treatment strategies without the commitment of real patients and the associated resources. Of course the better the dynamic model mimics the important aspects of the true interrelationship between treatment and patient outcomes, the better the adaptive treatment strategy proposals will be.

The Pineau et al. article uses methods from the field of “reinforcement learning” in computer science to construct adaptive treatment strategies from data. Reinforcement learning can be viewed as an extension of control theory to settings in which either mechanistic models are extremely complex or there is insufficient information to form a mechanistic model (recall the mechanistic model expresses how patient characteristics and outcomes to past treatment interact with present treatment to result in subsequent patient outcomes). These methods are often used in the field of artificial intelligence and in the development of games. In these settings greater reliance is placed on experimental, randomized, studies. The Pineau et al. article illustrates the use of a reinforcement learning method with the STAR*D data obtained from patients with major depressive disorder.

An important message communicated in the Pineau et al. paper is that methods from reinforcement learning are designed to evaluate not only the immediate effects of a treatment but also how this treatment increases the efficacy of prior and subsequent treatments. In other words, when considered as part of a sequence of treatments, a particular treatment is most valuable if it builds upon the successes of the prior treatments and sets the patient up for further and continued success with the subsequent treatments. An additional and easily overlooked effect is the diagnostic effect of a treatment. The diagnostic effect of a treatment is the treatment’s ability to elicit informative patient responses that permit the clinician to better match the subsequent treatment to the patient. Diagnostic effects are unimportant if one is considering a stand-alone treatment, however, in the context of an adaptive treatment strategy diagnostic effects of a treatment may become extremely important. All of these effects are incorporated into construction of adaptive treatment strategies by the reinforcement learning methods.

Trivedi et al. consider the crucial next step in the science of customizing treatment to the individual. Given an efficacious adaptive treatment strategy, how can one ensure that the strategy is used with fidelity in clinical practice? Trivedi et al. discuss the ideas behind the use of computerized decision support systems in improving fidelity. The computerized decision support systems proposed by Trivedi et al. are used during the clinic visit and thus provide critical information at the time treatment decisions are made. Furthermore Trivedi et al. emphasize a crucial ingredient of adaptive treatment strategies, that is, the use of measurement based care. In measurement based care, specific assessments of individual characteristics, symptoms, side effects, functionality, etc. rather than unstructured global judgments are used in the decision rules underlying the adaptive treatment strategy.

Conclusions

The six articles in this supplemental issue illustrate the benefits of adaptive treatment strategies, provide multiple intriguing approaches to constructing adaptive treatment strategies using clinical data and introduce a promising approach for ensuring that evidence-based adaptive treatment strategies can be used with fidelity in clinical practice. As these articles and others show, adaptive treatment strategies have the potential simultaneously to conserve resources and improve intervention efficacy and effectiveness by targeting treatments when and for whom they will do the most good. They deserve continued research attention and a prominent role in drug abuse treatment and related areas.

Review Process and Acknowledgements

This supplement was motivated by the formation of the Methodological Challenges in Constructing Adaptive Treatment Strategies (MCATS) network which includes scientists from fields as diverse as substance abuse, mental illness, HIV research, computer science, engineering and statistics. Multiple papers were invited for the supplement and underwent independent review by at least two external reviewers. The co-editors further reviewed the revised manuscripts before final acceptance. All manuscripts were additionally reviewed and approved by Robert L. Balster, editor-in-chief for Drug and Alcohol Dependence. Funding for this supplement was provided by National Institutes of Health Roadmap Grant, R21 DA019800 (Murphy, PI).

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Contributor Information

Susan A. Murphy, Institute for Social Research, University of Michigan, Ann Arbor, MI 48106-1248 USA, Email: samurphy/at/umich.edu, Fax: 734-763-5046, Phone: 734-763-5046.

Linda M. Collins, The Methodology Center and Department of Human Development and Family Studies, The Pennsylvania State University, University Park, PA 16802 USA.

A. John Rush M.D., University of Texas, Southwestern Medical Center at Dallas, Dallas, TX 75390 USA.

References

  • Brooner RK, Kidorf M. Using behavioral reinforcement to improve methadone treatment participation. Sci Pract Perspect. 2002;1:38–48. [PMC free article] [PubMed]
  • Collins LM, Murphy SA, Bierman KA. A conceptual framework foradaptive preventive interventions. Prev Sci. 2004;5:185–196. [PMC free article] [PubMed]
  • Crits-Christoph P, Siqueland L, Blaine J, Frank A, Luborsky L, Onken LS, Muenz LR, Thase ME, Weiss RD, Gastfriend DR, Woody GE, Barber JP, Butler SF, Daley D, Salloum I, Bishop S, Najavits LM, Lis J, Mercer D, Griffin ML, Moras K, Beck AT. Psychosocial treatments for cocaine dependence. Archives of General Psychiatry. 1999;56:493–502. [PubMed]
  • Lavori PW, Dawson R. A design for testing clinical strategies: Biased individually tailored within-subject randomization. Journal of the Royal Statistical Society A. 2000;163:29–38.
  • Lavori PW, Dawson R. Dynamic treatment regimes: Practical designconsiderations. Clin Trials. 2004;1:9–20. [PubMed]
  • Lavori PW, Dawson R, Rush AJ. Flexible treatment strategies in chronic disease: Clinical and research implications. Biol Psychiatry. 2000;48:605–614. [PubMed]
  • Lavori PW, Rush AJ, Wisniewski SR, Alpert J, Fava M, Kupfer DJ, Nierenberg A, Quitkin FM, Sackeim HA, Thase ME, Trivedi M. Strengthening clinical effectiveness trials: Equipoise-stratified randomization. Biol Psychiatry. 2001;50:792–801. [PubMed]
  • Lisziewicz J, Lori F. Structured treatment interruptions in hiv/aids therapy. Microbes and Infection. 2002;4:207–214. [PubMed]
  • McKay JR, Lynch KG, Shepard DS, Ratichek S, Morrison R, Koppenhaver J, Pettinati HM. The effectiveness of telephone-based continuing care in the clinical management of alcohol and cocaine use disorders: 12-month outcomes. J Consult Clin Psychol. 2004;72:967–979. [PubMed]
  • McLellan AT. Editorial: Have we evaluated addiction treatment correctly? Implications from a chronic care perspective. Addiction. 2002;97:249–252. [PubMed]
  • McLellan AT, Lewis DC, O’Brien CP, Kleber HD. Drug dependence, a chronic medical illness: Implications for treatment, insurance, and outcomes evaluation. JAMA. 2000;284:1689–1695. [PubMed]
  • Miller AL, Chiles JA, Chiles JK, Crismon ML, Rush AJ, Shon SP. The Texas Medication Algorithm Project (TMAP) schizophrenia algorithms. J Clin Psychiatry. 1999;60:649–57. [PubMed]
  • Murphy SA, McKay JR. Adaptive treatment strategies: An emerging approach for improving treatment effectiveness. Clinical Science. 2004. pp. 7–13. http://pantheon.yale.edu/~tat22/
  • Rush AJ, Crismon ML, Kashner TM, Toprac MG, Carmody TJ, Trivedi MH, Suppes T, Miller AL, Biggs MM, Shores-Wilson K, Witte BP, Shon SP, Rago WV, Altshuler KZ. TMAP Research Group. Texas Medication Algorithm Project, phase 3 (TMAP-3): Rationale and Study Design. J Clin Psychiatry. 2003;64:357–369. [PubMed]
  • Rush AJ, Rago WV, Crismon ML, Toprac MG, Shon SP, Suppes T, Miller AL, Trivedi MH, Swann AC, Biggs MM, Shores-Wilson K, Kashner TM, Pigott T, Chiles JA, Gilbert DA, Altshuler KZ. Medication treatment for the severely and persistently mentally ill: the Texas Medication Algorithm Project. J Clin Psychiatry. 1999b;60:284–291. [PubMed]
  • Schneider LS, Tariot PN, Lyketsos CG, Dagerman KS, Davis KL, Davis S, Hsiao JK, Jeste DV, Katz IR, Olin JT, Pollock BG, Rabins PV, Rosenheck RA, Small GW, Lebowitz B, Lieberman JA. National Institute of Mental Health Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) Am J Geriatr Psychiatry. 2001;9:346–360. [PubMed]
  • Sobell MB, Sobell LC. Stepped care as a heuristic approach to the treatment of alcohol problems. J Consult Clin Psychol. 2000;68:573–579. [PubMed]
  • Stone RM, Berg DT, George SL, Dodge RK, Paciucci PA, Sculman P, Lee EJ, Moore JO, Powell BL, Schiffer CA. Granulocyte-macrophage colony-stimulating factor after initial chemotherapy for elderly patients with primary acute myelogenous leukemia. New England Journal of Medicine. 1995;332:1671–1677. [PubMed]
  • Tummarello D, Mari D, Granziano F, Isidori P, Cetto G, Pasini F, Santo A, Cellerino R. A randomized, controlled, phase III study of cyclophosphamide, doxorubicin and vincristine with etoposide (CAV-E) or teniposide (CAV-T), followed by recombinant interferon-α maintenance therapy or observation, in small cell lung carcinoma patients with compete responses. Cancer. 1997;80:2222–2229. [PubMed]

Formats:

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...

Links

  • Cited in Books
    Cited in Books
    PubMed Central articles cited in books
  • PubMed
    PubMed
    PubMed citations for these articles

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...