J Consult Clin Psychol. 2005 Oct;73(5):924-35.

Empirically supported treatments or type I errors? Problems with the analysis of data from group-administered treatments.

Source

Department of Psychology, University of Memphis, Memphis, TN, USA. s.baldwin@mac.com

Abstract

When treatments are administered in groups, clients interact in ways that lead to violations of a key assumption of most statistical analyses-the assumption of independence of observations. The resulting dependencies, when not properly accounted for, can increase Type I errors dramatically. Of the 33 studies of group-administered treatment on the empirically supported treatments list, none appropriately analyzed their data. The current authors provide corrections that can be applied to improper analyses. After the corrections, only 12.4% to 68.2% of tests that were originally reported as significant remained significant, depending on what assumptions were made about how large the dependencies among observations really are. Of the 33 studies, 6-19 studies no longer had any significant results after correction. The authors end by providing recommendations for researchers planning group-administered treatment research.

PMID:: 16287392; [PubMed - indexed for MEDLINE]

Publication Types, MeSH Terms, Grant Support

Publication Types

MeSH Terms

Grant Support

F31MH73203-01/MH/NIMH NIH HHS/United States

LinkOut - more resources

Full Text Sources

Other Literature Sources

Supplemental Content

Icon for American Psychological Association

Save items

Related citations in PubMed

The role of method in treatment effectiveness research: evidence from meta-analysis. [Psychol Methods. 2001]
The role of method in treatment effectiveness research: evidence from meta-analysis.
Wilson DB, Lipsey MW. Psychol Methods. 2001 Dec; 6(4):413-29.
The control group dilemma in clinical research: applications for psychosocial and behavioral medicine trials. [Psychosom Med. 1997]
The control group dilemma in clinical research: applications for psychosocial and behavioral medicine trials.
Schwartz CE, Chesney MA, Irvine MJ, Keefe FJ. Psychosom Med. 1997 Jul-Aug; 59(4):362-71.
Review Identifying empirically supported treatments for phobic avoidance in individuals with intellectual disabilities. [Behav Ther. 2008]
Review Identifying empirically supported treatments for phobic avoidance in individuals with intellectual disabilities.
Jennett HK, Hagopian LP. Behav Ther. 2008 Jun; 39(2):151-61. Epub 2008 Jan 24.
Statistical analysis of group-administered intervention data: reanalysis of two randomized trials. [Psychother Res. 2008]
Statistical analysis of group-administered intervention data: reanalysis of two randomized trials.
Baldwin SA, Stice E, Rohde P. Psychother Res. 2008 Jul; 18(4):365-76.
Review Methodological issues associated with group intervention research. [Arch Psychiatr Nurs. 2006]
Review Methodological issues associated with group intervention research.
Murphy SA, Johnson LC. Arch Psychiatr Nurs. 2006 Dec; 20(6):276-81.

See reviews... See all...

Cited by 10 PubMed Central articles

Guided self-help concreteness training as an intervention for major depression in primary care: a Phase II randomized controlled trial. [Psychol Med. 2012]
Guided self-help concreteness training as an intervention for major depression in primary care: a Phase II randomized controlled trial.
Watkins ER, Taylor RS, Byng R, Baeyens C, Read R, Pearson K, Watson L. Psychol Med. 2012 Jul; 42(7):1359-71. Epub 2011 Nov 16.
Evaluating Group-Based Interventions When Control Participants Are Ungrouped. [Multivariate Behav Res. 2008]
Evaluating Group-Based Interventions When Control Participants Are Ungrouped.
Bauer DJ, Sterba SK, Hallfors DD. Multivariate Behav Res. 2008 Apr 2; 43(2):210-236.
Randomized controlled trial of a family cognitive-behavioral preventive intervention for children of depressed parents. [J Consult Clin Psychol. 2009]
Randomized controlled trial of a family cognitive-behavioral preventive intervention for children of depressed parents.
Compas BE, Forehand R, Keller G, Champion JE, Rakow A, Reeslund KL, McKee L, Fear JM, Colletti CJ, Hardcastle E, et al. J Consult Clin Psychol. 2009 Dec; 77(6):1007-20.

See all...

Related information

Related Citations
Calculated set of PubMed citations closely related to the selected article(s) retrieved using a word weight algorithm. Related articles are displayed in ranked order from most to least relevant, with the “linked from” citation displayed first.
Cited in PMC
Full-text articles in the PubMed Central Database that cite the current articles.

Recent activity

Clear Turn Off Turn On

Empirically supported treatments or type I errors? Problems with the analysis of...
Empirically supported treatments or type I errors? Problems with the analysis of data from group-administered treatments.
J Consult Clin Psychol. 2005 Oct ;73(5):924-35.

PubMed
Mucus clearance with three chest physiotherapy regimes in cystic fibrosis: a com...
Mucus clearance with three chest physiotherapy regimes in cystic fibrosis: a comparison between postural drainage, PEP and physical exercise.
Eur Respir J. 1992 Jun ;5(6):748-53.

PubMed
Conducting polymer electrochemical switching as an easy means for designing acti...
Conducting polymer electrochemical switching as an easy means for designing active plasmonic devices.
J Am Chem Soc. 2005 Nov 23 ;127(46):16022-3.

PubMed
Development and brain delivery of chitosan-PEG nanoparticles functionalized with...
Development and brain delivery of chitosan-PEG nanoparticles functionalized with the monoclonal antibody OX26.
Bioconjug Chem. 2005 Nov-Dec ;16(6):1503-11.

PubMed
Mutation and polymorphism spectrum of the GALNS gene in mucopolysaccharidosis IV...
Mutation and polymorphism spectrum of the GALNS gene in mucopolysaccharidosis IVA (Morquio A).
Hum Mutat. 2005 Dec ;26(6):500-12.

PubMed

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

PubMed

Result Filters

Display Settings:

Send to: