Logo of jmirEditorial BoardMembershipSubmitCurrent IssueArchiveReviewSearchAboutJMIR PublicationsJMIR
J Med Internet Res. 2008 Apr-Jun; 10(2): e14.
Published online 2008 May 19. doi:  10.2196/jmir.1033
PMCID: PMC2483919

Therapist-Assisted, Internet-Based Treatment for Panic Disorder: Can General Practitioners Achieve Comparable Patient Outcomes to Psychologists?

Monitoring Editor: Gunther Eysenbach
Reviewed by Anonymous, Per Carlbring, and Gerhard Andersson
Kerrie Shandley, MPsych (Health),corresponding author1 David William Austin, PhD,1 Britt Klein, DPsych (Clinical),1 Ciaran Pier, PhD,2 Peter Schattner, FRACGP,3 David Pierce, MMed, FRACGP,4 and Victoria Wade, MPsych, FRACGP5
5Adelaide Western General Practice Network, Woodville, South Australia, Australia
4School of Rural Health, Melbourne University, Parkville, Victoria, Australia
3Department of General Practice, Monash University, Notting Hill, Victoria, Australia
2School of Psychology, Deakin University, Burwood, Victoria, Australia
1Faculty of Life and Social Sciences, Swinburne University of Technology, Hawthorn, Victoria, Australia
Kerrie Shandley, Swinburne University of Technology, Faculty of Life and Social Sciences, Mail H31, PO Box 218, Hawthorn, Victoria 3122, Australia, Phone: +61 9214 4681, ua.ude.niws@yeldnahsk.



Mental illness is an escalating concern worldwide. The management of disorders such as anxiety and depression largely falls to family doctors or general practitioners (GPs). However, GPs are often too time constrained and may lack the necessary training to adequately manage the needs of such patients. Evidence-based Internet interventions represent a potentially valuable resource to reduce the burden of care and the cost of managing mental health disorders within primary care settings and, at the same time, improve patient outcomes.


The present study sought to extend the efficacy of a therapist-assisted Internet treatment program for panic disorder, Panic Online, by determining whether comparable outcomes could be achieved and maintained when Panic Online was supported by either GPs or psychologists.


Via a natural groups design, 96 people with a primary diagnosis of panic disorder (with or without agoraphobia) completed the Panic Online program over 12 weeks with the therapeutic assistance of their GP (n = 53), who had received specialist training in cognitive behavioral therapy, or a clinical psychologist (n = 43). Participants completed a clinical diagnostic telephone interview, conducted by a psychologist, and a set of online questionnaires to assess panic-related symptoms at three time periods (pretreatment, posttreatment, and 6 month follow-up).


Both treatments led to clinically significant improvements on measures of panic and panic-related symptomatology from pretreatment to posttreatment. Both groups were shown to significantly improve over time. Improvements for both groups were maintained at follow-up; however, the groups did differ significantly on two quality of life domains: physical (F1,82 = 9.13, P = .00) and environmental (F1,82 = 4.41, P = .04). The attrition rate was significantly higher among those being treated by their GP (χ 2 1 = 4.40, P = .02, N = 96).


This study provides evidence that Internet-based interventions are an effective adjunct to existing mental health care systems. Consequently, this may facilitate and enhance the delivery of evidence-based mental health treatments to increasingly large segments of the population via primary care systems and through suitably trained health professionals.

Keywords: Panic disorder, anxiety, Internet, mental health, general practice, cognitive behavioral therapy, email


Projections indicate that by the year 2020 mental health and neurological disorders will account for 15% of the global burden of disease [1]. Such worldwide estimates are comparable in Australia, with mental illness accounting for 13% of total disease burden [2] and 1 in 10 Australian adults reporting that they suffer from a long-term mental or behavioral problem [3].

Despite the high prevalence, up to 40% of people experiencing a mental health problem do not receive any mental health care within a given 12-month period [4]. Typically, when treatment is sought, general practitioners (GPs) are the first, and often only, point of contact [5,6], with a recent Australian national survey finding that psychological problems account for 7.8% of GP visits [7]. Seeking help from a GP confers a number of advantages over other mental health professionals, such as psychologists and psychiatrists, in that GP visits are more accessible, affordable, and less stigmatizing [8].

In an attempt to address gaps in mental health care service provision in Australia, and in recognition of the critical role GPs play in service delivery, the government has expanded the number of Medicare (Australia’s universal health care system) rebate items for mental health consultations, and, in 2001, introduced the Better Outcomes in Mental Health Care (BOiMHC) initiative. The BOiMHC initiative includes educational activities and financial incentives to improve the capacity of GPs to deliver evidence-based psychological interventions such as cognitive behavioral therapy (CBT) [9]. Although the initiative has been welcomed by the health industry and consumers, difficulties in service provision remain. For example, GPs often lack the time and necessary resources and support mechanisms to deliver appropriate psychological interventions to their patients, such as clinical supervision [10]. Consequently, not all GPs and/or regional divisions of general practice choose to participate, thereby creating inequitable patient access. As such, it is important to consider alternative models of delivering effective, evidence-based therapy, particularly for use in primary care. One promising and emerging service delivery modality is the Internet.

Internet-Based Therapy

Internet-based therapy (eTherapy) typically involves the interaction between a consumer and therapist (eTherapist) via the Internet [11] and incorporates the use of a structured Web-based treatment program for consumers to access in conjunction with eTherapist assistance (usually by email) [12]. Approximately 84% of Australians have access to the Internet [13]; consequently, eTherapy programs offer a unique opportunity to deliver evidence-based mental health treatment, without the need for intensive therapist involvement, to large underserved segments of the population.

Over the past decade, Internet-based treatments have been found effective for a variety of physical health conditions and mental health disorders, such as headache [14], encopresis [15], tinnitus [16], depression [17], and posttraumatic stress symptoms [18]. Based on existing research, the psychological disorder most effectively treated via the Internet is one of the most common anxiety disorders—panic disorder.

Panic Disorder

Panic disorder affects approximately 1.3% (with agoraphobia, 2.4%) of the Australian population annually [5]. It is characterized by recurrent unexpected panic attacks and is commonly associated with other anxiety disorders [6], depression [19,20], increased risk of suicide [19], and substance and alcohol abuse [20]. Its incidence among people attending general practices has been estimated to be as high as 1 in 12 [21].

CBT is a well established and highly effective treatment for panic disorder (with or without agoraphobia) [22]. The efficacy of CBT for panic disorder appears uncompromised when patients have comorbid depression [23] and when it is transferred from controlled research settings to real-world clinical settings [24]. Although CBT is effective for people with panic disorder, it typically averages 12 hours of face-to-face treatment with a mental health specialist [25]. Furthermore, there are major barriers to accessing expert assistance, including a scarcity of skilled therapists, long waiting lists, high cost, illness symptoms, comorbid conditions, sociodemographic factors, psychological distress, and consumer fears regarding the stigma of a mental health referral [26,27]. These barriers particularly disadvantage people in regional and rural areas where travelling time and distance are an added burden [28].

Internet-based treatments largely address all of these barriers, and, indeed, panic disorder has been effectively treated via the Internet in a number of countries including Sweden [29-31] and the United Kingdom [32]. In Australia, one Internet program for panic disorder, Panic Online (PO), has been developed and extensively evaluated over the past decade.

Panic Online

Clinical trials have shown that PO, when paired with human support via email (provided by psychologist), is clinically superior to information-only control conditions or other forms of manual and telephone-based therapy [33,34]. PO has also been found to be credible and satisfying to participants [34], and outcomes are unaffected by level of education [35]. Furthermore, a recent exploratory study indicated that PO has the potential to be highly cost-effective [36]. Additionally, PO was recognized by the National Institute of Clinical Studies [37], and notably in a recent meta-analysis, it attained the largest effect size for an Internet-based treatment for a clinical mental health disorder [38].

To our knowledge, PO has not previously been trialled with professional support beyond that of a psychologist, except our own study [39]. This paper reports on the full dataset from a study for which preliminary findings from a limited dataset have been published previously [39]. Given the central role that GPs have in the health system, the aim of the present study was to extend our current understanding of PO’s efficacy by examining participant outcomes when the program is supported by a GP in a traditional face-to-face consultation in comparison to eTherapist assistance.



A total of 193 people registered for the study, and after 97 were excluded on the basis of inclusion/exclusion criteria, a total of 96 individuals ultimately commenced treatment as part of this study: 43 were recruited into the PO plus psychologist support via email (PO+P) group and 53 into the PO plus face-to-face GP (PO+GP) group.

In total, 132 BOiMHC-trained (CBT-trained) GPs registered to participate in the study, of which 37 actively referred the 53 PO+GP patients and treated participants as per the standardized protocol. Seven psychologists (6 females; 1 male) were employed as eTherapists for the PO+P group and as assessors for both groups.


This study utilized three assessment phases (pretreatment, posttreatment, and 6-month follow-up after treatment). Each assessment included a clinical interview conducted over the telephone by a psychologist and the completion of a set of self-administered questionnaires accessed via the Internet. Recent studies have shown that the majority of validated paper-and-pencil questionnaires generally retain their psychometric qualities and produce equivalent results when administered in an online format [40,41].

Anxiety Disorders Interview Schedule-IV

The Anxiety Disorders Interview Schedule-IV (ADIS-IV) is a semistructured clinical interview designed to permit differential diagnosis among anxiety and mood disorders and to screen for other major disorders (eg, substance abuse, psychosis, somatoform disorders). It includes the “number of panic attacks in the last month” (PAMTH). The ADIS-IV has good-to-excellent reliability and validity [42]. In the present study, the ADIS-IV was used to determine eligibility and participant diagnosis at each assessment phase.

Anxiety Sensitivity Profile

The Anxiety Sensitivity Profile (ASP) [43] is a 60-item questionnaire measuring the extent to which respondents are fearful that anxiety-related sensations will have harmful consequences. Respondents rate, on a 7-point Likert scale, the extent to which they agree that the sensations described would lead to a bad outcome. The ASP has high test-retest reliability [43].

Depression Anxiety Stress Scale

The Depression Anxiety Stress Scale (DASS) [44] is composed of three 14-item subscales measuring depression, anxiety, and stress. The extent to which a variety of symptoms were experienced within the prior week is rated on a 4-point Likert scale. Alpha coefficients have been reported at .91, .84, and .90 for the depression, anxiety, and stress subscales, respectively [44].

Mobility Inventory

The Mobility Inventory (MI) [45] is a measure of agoraphobic avoidance behavior, comprising 27 items. Participants indicate, on a 5-point Likert scale (1 = never avoid to 5 = always avoid), the degree to which they avoid a variety of places or situations when they are alone (MIA) and accompanied (MIB). Acceptable psychometrics have been reported for the MI [45-48].

Panic Disorder Severity Scale

The Panic Disorder Severity Scale (PDSS) [49] consists of seven items rated on a 5-point Likert scale (0 = not at all to 4 = most severe). The PDSS is designed to assess the severity of seven dimensions of panic disorder (panic attack frequency, panic attack distress, anticipatory anxiety, agoraphobia fear and avoidance, interoceptive fear and avoidance, occupational impairment/interference, and social impairment/interference) and associated symptoms. The seven items are summed to derive a total score ranging from 0-28, with higher scores reflecting greater symptom severity. The PDSS has excellent interrater reliability and good validity [49].

Treatment Credibility Scale-Modified

The Treatment Credibility Scale-Modified (TCS-M) [50] measures respondents’ attitudes to the credibility of a nominated treatment (in this study, either PO+P or PO+GP). Respondents rate five items on a 10-point scale (0 = not at all to 10 = very much) with respect to how credible they consider their allocated treatment to be after having read a brief rationale and description of the treatment. Higher scores reflect greater levels of perceived credibility.

World Health Organization Quality of Life-BREF

The World Health Organization Quality of Life-BREF (WHOQOL-BREF) [51] is a 26-item questionnaire developed from the original WHOQOL 100-item questionnaire. The WHOQOL-BREF covers four domains: physical health (eg, sleep, pain), psychological health (eg, self-esteem, concentration), social relationships (eg, social support, personal relationships), and environment (eg, physical safety, financial resources, recreation).


Study Design

The present study employed a natural groups design open to all Australian residents who met the inclusion criteria (detailed below). Participants who were referred to the program by their GP were allocated back to their GP for treatment and were therefore in the PO+GP group. Participants who self-referred to the program (eg, found it via Web surfing, word-of-mouth) were allocated to receive PO supported by an eTherapist and were therefore in the PO+P group.


The study was advertised to the general public via participating GPs, Australian mental health websites, and local and national media. Study volunteers could register their interest on the PO website.

GPs were recruited in Victoria, South Australia, and New South Wales via BOiMHC-accredited training programs. Participating GPs were sent a project information package and subsequently were contacted by a research officer (either in person or via telephone) to discuss research protocols, PO program components, the manner in which PO was to be used, and the expected role of the GP and patient in the study. Additionally, regular consultative support was provided by the research officer throughout the duration of the study.

Inclusion/Exclusion Criteria

To be included in the study, participants were required to be Australian residents, have computer access, be 18 years or over, be fluent in English, have a primary diagnosis of panic disorder (with or without agoraphobia; as determined via the clinical telephone interview), and to agree not to undertake any other type of therapy for their panic disorder during the study. The request to refrain from other treatments did not cover the follow-up period. At post-assessment, all participants but one (whose data were removed from the analysis) had refrained from other treatments, as measured by self-report.

People were excluded if they reported a seizure disorder, stroke, schizophrenia, hyperthyroidism, organic brain syndrome, heart condition, or chronic hypertension as these are confounding variables with independent associations with panic attacks [52]. People were likewise excluded if they had commenced taking medication in the previous 12 weeks or were not stabilized on their medication dose since this has the potential to confound any treatment effects found for PO.


Study registrants were contacted by a psychologist who conducted a screening interview to determine whether they met the exclusionary criteria. When exclusionary criteria were met, volunteers were advised of the reason they could not participate and were referred to alternative services as appropriate. When exclusionary criteria were not met, an explanatory statement and consent form were emailed. Upon return of consent, a full clinical diagnostic assessment was conducted via telephone using the ADIS-IV, which took, on average, 90 minutes. Our interrater reliability for this procedure was .93. Following this, participants completed a set of online questionnaires. Upon assessment completion, participants were emailed a username and password with instructions on accessing the PO program. Posttreatment and follow-up assessments (clinical telephone interview and online questionnaires) were conducted at the end of week 12 and 6 months later. Psychologists did not provide therapy for any participant they assessed.

The Panic Online Program

PO is a 12-week eTherapy program consisting of an introductory module, four learning modules, and a relapse prevention module. The program includes treatment methods commonly used in standard CBT for panic disorder, including instructions for controlled breathing, progressive muscle relaxation, cognitive restructuring, and interoceptive and situational exposure. Downloadable audio of isometric and progressive muscle relaxation and sequential photographic slide shows for two graduated exposure in vivo exercises (going to the supermarket and driving a car) were provided. An adjunct stress management program was also available to all participants (see Richards et al [34]). Information and guidance throughout the program were standardized across participants.

Panic Online With Psychologists (PO+P)

Communication between participants and psychologists occurred via email. No limitations were placed on email frequency; however, the assigned eTherapist was instructed to initiate contact if he or she had not received communication from a participant for approximately 1-2 weeks. On average, per participant, eTherapists sent 15.29 emails (SD 9.26; n = 31) and spent 378.62 minutes (SD 264.43; n = 29) emailing participants throughout the 12-week treatment. On average, each eTherapist provided support to 7.17 (range 2-19) participants.

Panic Online With General Practitioners (PO+GP)

Following assessment by a psychologist, participants allocated to the PO+GP condition were asked to make an appointment with their GP for their first PO consultation. The GP was then informed by the assessor that the patient could commence treatment. GPs and participants were encouraged to consult regularly (approximately once per week) throughout the treatment duration, while participants were using PO between consultations. On average, participants saw their GP (in a face-to-face consultation) 7.14 times (n = 31) throughout the 12-week treatment.

Statistical Methods

An independent groups t test was conducted to assess treatment credibility. Three repeated measures multivariate analysis of variance (MANOVA), an analysis of covariance (ANCOVA), and an independent groups t test were performed to analyze data from this study. MANOVA was conducted to reduce the possibility of type II errors. The first repeated measures MANOVA examined panic symptoms and included the following: clinician-rated panic disorder and agoraphobia severity (as indicated by the ADIS-IV), PAMTH, ASP, and PDSS scores. The second MANOVA examined negative affect and included the three DASS subscales of depression, anxiety, and stress. The final MANOVA examined quality of life and included three of the four WHOQOL-BREF domains (physical, social, and environmental). Lastly, an ANCOVA was conducted to analyze the WHOQOL-BREF psychological domain using the pretreatment assessment score as the covariate. This was analyzed separately as there was a significant difference in the pre-assessment treatment scores between the two groups.


Participant Characteristics

In addition to their primary diagnosis of panic disorder, 75 participants were also assessed with clinical levels of agoraphobia (30 in the PO+P group and 45 in the PO+GP group). See Table 1 for a summary of participant characteristics. At pretreatment assessment, 52% of participants were taking medication (19 in the PO+P group and 31 in the PO+GP group). Table 2 provides a breakdown of medication frequencies at pretreatment assessment. Over half of the sample (n = 56) received a secondary clinical diagnosis at pretreatment assessment. Table 3 provides a breakdown of the frequencies of clinically significant comorbid conditions at pretreatment.

Table 1
Characteristics of participants at pretreatment assessment, by group
Table 2
Medication frequencies at pretreatment assessment, by group
Table 3
Clinical comorbid condition frequencies at pretreatment assessment, by group*


Attrition was defined as participants who withdrew, for reasons either known or unknown, from the research trial. The overall attrition rate for this study was 42.7% (41/96): 37.2% (16/43) and 47.2% (25/53) for the PO+P and PO+GP groups, respectively. This difference was not significant (χ 2 1 = .60, P = .41, N = 96). Attrition from the treatment and follow-up phase was also examined separately. Overall attrition from pretreatment to posttreatment was 28.1% (27/96), with 16.3% (7/43) dropping out of the PO+P group and 37.7% (20/53) from the PO+GP group. Fisher exact test revealed that significantly more participants in the PO+GP group dropped out of the treatment (χ 2 1 = 4.40, P = .02, N = 96). A further 14 participants (14.6%) were lost from the study between posttreatment and follow-up assessment. The overall attrition rate from posttreatment to follow-up by condition was 20.9% (9/43) for the PO+P group and 9.4% (5/53) for the PO+GP group; this difference was not significant (χ 2 1 = 1.68, P = .15, N = 96). Table 4 provides reasons for attrition.

Table 4
Reasons for attrition, by group

Data Properties and Treatment

This study utilized intention-to-treat analyses. That is, pretreatment assessment scores for participants discontinuing their involvement during treatment were carried forward and used in both the posttreatment and follow-up assessments (11 for the PO+P group; 21 for the PO+GP group). Fisher exact test revealed no difference between the groups (χ 2 1 = 1.52, P = .19, N = 96). A further 16 PO+P and 13 PO+GP posttreatment assessment scores were carried forward and used in the follow-up assessment. The difference was not significant (χ 2 1 = 1.26, P = .19, N = 96).

Nonnormally distributed dependent variables were transformed to satisfy normality assumptions. The DASS depression subscale and the MIA required a square root transformation, and PAMTH required a logarithmic transformation.

One-way analysis of variance (ANOVA) tests were conducted on all measures to test for pretreatment differences between groups. A significant pretreatment difference was found in the WHOQOL-BREF psychological domain, with the PO+P group reporting greater quality of life for this domain in comparison to the PO+GP group (Table 5 and Table 6). However, no differences were found between the treatment groups for any other measure (see Table 5). Furthermore, no significant pretreatment assessment differences were detected for age (F1,94 = 4.09, P = .05), gender (χ 2 1 = .08, P = .62, N = 96), agoraphobia (χ 2 1 = 2.36, P = .09, N = 96), medication use (χ 2 1 = 1.42, P = .22, N = 96), presence of clinically significant comorbid condition (χ 2 1 = 1.16, P = .22, N = 96), years of education (F1,81 = .10, P = .75), or previous inpatient or outpatient treatment for a mental health condition (χ 2 1 = .35, P = .54, N = 96).

Table 5
F ratios and P values from pretreatment assessment ANOVA
Table 6
Means and standard deviations for treatment outcome measures at pretreatment, posttreatment, and follow-up treatment assessments, by group

Results of evaluation of normality assumptions, homogeneity of variance-covariance matrices, and linearity were satisfactory. Additionally, Bartlett’s test of sphericity was conducted to confirm that the dependent variables in the MANOVA groupings were correlated at the P < .05 level. A multivariate outlier was detected in the panic symptoms MANOVA grouping and was subsequently removed due to its impact on the mean.

Treatment Outcomes

Treatment Credibility

An independent samples t test revealed no significant differences between the groups for perceived treatment credibility prior to treatment (t 82 = 1.96, P = .05).

Panic Symptoms

For the panic symptoms grouping, repeated measures MANOVA revealed no significant interaction between time (pre, post, follow-up) and group (PO+P, PO+GP) or group main effect. However, a significant main effect for time was found from pretreatment to posttreatment assessment. Examination of the univariate tests for time and associated means revealed a significant decrease on all seven measures. Means and standard deviations are presented in Table 6, multivariate results in Table 7, and univariate results in Table 8.

Table 7
Effects from the repeated measures MANOVA and ANCOVA analysis between groups*
Table 8
Effects from univariate tests

Negative Affect

For the negative affect grouping, repeated measures MANOVA revealed no significant interaction between time and group or group main effect. However, a significant main effect for time was found from pretreatment to post treatment assessment (see Table 7). Examination of the univariate tests for time (see Table 8) and associated means (see Table 6) revealed a significant decrease on all three DASS subscales.

Quality of Life

For the quality of life grouping, repeated measures MANOVA revealed no significant interaction between time and group. However, a significant main effect for time from pretreatment to posttreatment assessment and a significant main effect for group from posttreatment to follow-up assessment were found (see Table 7). Examination of the univariate tests for time (see Table 8) and associated means (see Table 6) revealed a significant positive change on all three domains from pretreatment to posttreatment. Examination of the univariate between-subject effects from posttreatment to follow-up revealed a significant difference between the groups for the WHOQOL-BREF physical and environmental domains. The mean scores for both domains (see Table 6) showed that the PO+P group experienced a slight improvement, whereas the PO+GP group showed a slight decrease from posttreatment to follow-up.

WHOQOL-BREF (Psychological)

An ANCOVA was conducted on the psychological domain of the WHOQOL-BREF from pretreatment to posttreatment and posttreatment to follow-up. No significant differences were detected (see Table 7).

Panic-Free Status and High-End State Functioning

Panic-free status and high-end state functioning were examined at posttreatment and follow-up assessment. Panic-free status was defined as zero panic attacks reported during the month immediately prior to the assessment. At posttreatment assessment, panic-free status was achieved by 52.4% (22/42) of the PO+P group and 50.9% (27/53) of the PO+GP group; this difference was not significant (χ 2 1 = .00, P = 1.00, N = 95). At follow-up, 52.4% (22/42) of the PO+P group and 47.2% (25/53) of the PO+GP group were panic free, but this difference was also not significant (χ 2 1 = .09, P = .68, N = 95).

High-end state functioning was defined as being panic free and having a clinician-rated panic disorder score ≤ 2. At posttreatment assessment, 28.6% (12/42) of the PO+P group and 26.4% (14/53) of the PO+GP group achieved high-end state functioning, but this difference was not statistically significant (χ 2 1 = .00, P = .82, N = 95). At follow-up, 47.6% (20/42) of the PO+P group and 32.1% (17/53) of the PO+GP group achieved high-end state functioning, but again, the difference was not significant (χ 2 1 = 1.77, P = .14, N = 95). However, for the PO+P group, the increase in high-end state functioning from posttreatment to follow-up was significant (t 41 = −2.44, P = .02).


The purpose of the current study was to investigate whether the established efficacy of PO was affected by changing the form of therapist assistance from email support provided by psychologists (eTherapists) to face-to-face support provided by GPs, and, further, whether treatment improvements were maintained. The results of this study support findings from several previous studies examining Internet programs in primary care [53,54] and demonstrate that evidence-based eTherapy programs could be a valuable tool for GPs managing patients with mental health conditions.

The recommended treatment for panic disorder includes CBT, medication (antidepressants and/or benzodiazepines), or a combination of both [55]. However, there are difficulties associated with each form of treatment. Barriers such as accessibility, waiting lists, cost, and stigma inhibit access to CBT experts [26,27], and use of pharmacotherapy is often complicated by side effects, compliance, and other health considerations [56]. Furthermore, medication use in comparison to CBT treatment does not appear to result in sustained recovery beyond discontinuation [56,57]. Consequently, investigating other methods of delivering cost-effective and clinically effective treatment is important to address the growth of mental health disorders both in general practice and the wider community.

In this study, PO (whether supported by eTherapists or face-to-face GPs) led to significant improvements in panic attack frequency, depression, anxiety, stress, anxiety sensitivity, agoraphobia avoidance, and quality of life. Improvements were maintained at follow-up, with the only significant differences occurring on the WHOQOL-BREF physical and environmental domains. It is beyond the capacity of this study to ascertain definitively why the groups differed on these particular measures. It is possible to speculate, however, that the different dissemination processes (email vs face-to-face) created disparate learning experiences between the groups, resulting in the PO treatment information being used and retained in different manners. Further, while the groups did not significantly differ on any pretreatment assessment sociodemographic measure, the PO+GP group did have a higher degree of comorbidity and proportion of participants on medication. Consequently, it is possible that this study inherently measured two different cohorts.

Surprisingly, attrition from treatment was significantly higher for the PO+GP group. A number of possible reasons can be hypothesized. First, there was variation in the level of support throughout the duration of the trial. While participants in the PO+GP group were encouraged to regularly access their GP throughout treatment, this was not a requirement, and GP visitations could not be reasonably regulated within this study. By contrast, participants in the PO+P group were able to email their therapist as often as they wished, and their therapist was required to respond within 24 hours. Second, greater effort and planning are required to attend a medical practice in comparison to writing an email. Consequently, participants in the PO+P group may have experienced a greater level of continuous support and encouragement to adhere to the treatment. It is also worth noting that while treatment credibility was not significantly different between the groups, it did near significance, with the PO+P treatment appearing to be viewed more favorably than the PO+GP treatment. Finally, it is not known whether the content of GP visits focused specifically on panic disorder or incorporated consultation on other unrelated ailments. However, in comparison to other Internet-based studies [14,16], attrition overall in this study was relatively low.

It is noteworthy that the proportion of participants achieving high-end state functioning in both groups continued to increase from posttreatment to follow-up and that for the PO+P group, the increase was significant. These results not only support the durability of PO to maintain treatment outcomes but also indicate that it has the capacity to continue to have benefits beyond treatment completion.


There are several methodological issues and limitations to note. The primary limitation of this study was that it used a nonrandomized, natural groups design. Consequently, we can not speak to the direct comparability of these two treatments, and it is possible that the groups differed in ways not considered within this study. It should also be mentioned that all participating GPs were trained in delivering CBT. It is unknown whether non-CBT-trained GPs would achieve similar outcomes. This issue would benefit from further investigation as the accessibility to the program would be increased substantially if the evidence base indicated that all GPs were able to effectively support patients using the program. As discussed earlier, the treatments differed in terms of the supportive communication modality employed. This factor may have affected attrition and was not investigated. A final issue relates to PO access. Unfortunately, participant usage statistics (eg, number of times accessed PO, duration of time spent on PO) were not available. Consequently, it is possible that one group may have spent a proportionally greater period of time accessing and/or reading the PO material and therefore achieved and sustained greater benefits.


A number of implications for policy and practice can be derived from this study. While it is anticipated that there might be reluctance to adopt eTherapy into general practice [58], this study has demonstrated the capacity of evidence-based programs, such as PO, to aid GPs in the management of mental health disorders, such as panic disorder, and achieve sustained outcomes, making them an invaluable tool. However, at present, there is no specific Medicare and/or private health insurance rebates on such services. Furthermore, there is need for appropriate educational and financial support within primary care to integrate these programs within existing public health systems.


This study demonstrates that when panic disorder sufferers are provided with accessible online treatment protocols, CBT-skilled GPs can achieve sustained patient outcomes comparable to best-practice treatments delivered by psychologists. Further research will be required to evaluate Internet-based programs for other mental health conditions and with non-CBT-trained GPs. Nevertheless, this study provides strong evidence that the use of Internet-based programs is an effective adjunct to existing mental health care services and may enable the delivery of evidence-based treatments to increasingly large numbers of patients via primary care with the support of suitably trained health professionals.


The authors wish to acknowledge the contribution of the late Professor Jeffrey Richards, instigator and former chief investigator of this research.

Funding for this research project was provided by the beyondblue Victoria Centre of Excellence in Depression and Related Disorders. Funding for the original development of the PO eTherapy program used in this study was granted to the original chief investigator, the late Professor Jeffrey Richards, by the Australian Rotary Health Research Fund.


ASPAnxiety Sensitivity Profile
BOiMHCBetter Outcomes in Mental Health Care
CBTcognitive behavioral therapy
DASSDepression Anxiety Stress Scale
GPgeneral practitioner
MIAMobility Inventory alone
MIBMobility Inventory accompanied
PAMTHpanic attacks in the last month
PDSSPanic Disorder Severity Scale
POPanic Online
WHOQOL-BREFWorld Health Organization Quality of Life-BREF


Conflicts of Interest:

None declared.


1. Murray C J, Lopez A D. Alternative projections of mortality and disability by cause 1990-2020: Global Burden of Disease Study. Lancet. 1997 May 24;349(9064):1498–504. doi: 10.1016/S0140-6736(96)07492-2.S0140-6736(96)07492-2 [PubMed] [Cross Ref]
2. Australian Institute of Health and Welfare, authors. Australia’s Health 2006. AIHW cat. no. AUS 73. Canberra, Australia: Australian Institute of Health and Welfare; 2006. [2008 Apr 16]. webcite http://www.aihw.gov.au/publications/aus/ah06/ah06.pdf.
3. Australian Bureau of Statistics (ABS), authors National Health Survey: Summary of Results, 2004-05. ABS cat. no. 4364.0. Canberra, Australia: Australian Bureau of Statistics; 2006. [2008 Apr 16]. webcite http://www.ausstats.abs.gov.au/ausstats/subscriber.nsf/0/3B1917236618A042CA25711F00185526/$File/43640_2004-05.pdf.
4. Hickie Ian B, Groom Grace L, McGorry Patrick D, Davenport Tracey A, Luscombe Georgina M. Australian mental health reform: time for real outcomes. Med J Aust. 2005 Apr 18;182(8):401–6. http://www.mja.com.au/public/issues/182_08_180405/hic10810_fm.html.hic10810_fm [PubMed]
5. Andrews G, Hall W, Teeson M, Henderson S. The Mental Health of Australians. Canberra, Australia: Mental Health Branch, Australian Commonwealth Department of Health and Aged Care; 1999. [2008 Apr 16]. webcite http://www.health.gov.au/Internet/wcms/publishing.nsf/Content/78CA239BC007B0ADCA2572880002E508/$File/mhatitle.pdf.
6. Andrews G, Henderson S, Hall W. Prevalence, comorbidity, disability and service utilisation. Overview of the Australian National Mental Health Survey. Br J Psychiatry. 2001 Feb;178(2):145–53. doi: 10.1192/bjp.178.2.145. http://bjp.rcpsych.org/cgi/pmidlookup?view=long&pmid=11157427. [PubMed] [Cross Ref]
7. Britt H, Miller GC, Charles J, Pan Y, Valenti L, Henderson J, Bayram C, O’Halloran J, Knox S. General Practice Activity in Australia 2005-08. General Practice Series no. 19. AIHW cat. no. GEP 19. Canberra, Australia: Australian Institute of Health and Welfare; 2007. [2008 Apr 16]. webcite http://www.aihw.gov.au/publications/gep/gpaa05-06/gpaa05-06-c00.pdf.
8. Keks N A, Altson B M, Sacks T L, Hustig H H, Tanaghow A. Collaboration between general practice and community psychiatric services for people with chronic mental illness. Med J Aust. 1997 Sep 1;167(5):266–71. http://www.mja.com.au/public/mentalhealth/articles/keks2/keks2.html. [PubMed]
9. Pirkis J, Stokes D, Morley B, Kohn F, Mathews R, Naccarella L, Blashki G, Shandley K, Littlefield L, Burgess P. Impacts of Australia’s Better Outcomes in Mental Health Care program for psychologists. Aust Psychol. 2006;41(3):152–159. doi: 10.1080/00050060600752656. [Cross Ref]
10. Blashki Grant, Hickie Ian B, Davenport Tracey A. Providing psychological treatments in general practice: how will it work? Med J Aust. 2003 Jul 7;179(1):23–5. http://www.mja.com.au/public/issues/179_01_070703/bla10086_fm.html.bla10086_fm [PubMed]
11. Castelnuovo Gianluca, Gaggioli Andrea, Mantovani Fabrizia, Riva Giuseppe. From psychotherapy to e-therapy: the integration of traditional techniques and new communication tools in clinical settings. Cyberpsychol Behav. 2003 Aug;6(4):375–82. doi: 10.1089/109493103322278754. [PubMed] [Cross Ref]
12. Abbott J, Klein B, Ciechomski L. Best practices in online therapy. J Technol Hum Serv. forthcoming.
13. Australian Bureau of Statistics (ABS), authors Household Use of Information Technology, 2005-06. Canberra, Australia: Australian Bureau of Statistics; 2006. [2008 Apr 16]. webcite http://www.ausstats.abs.gov.au/Ausstats/subscriber.nsf/0/CA78A4186873588CCA2570D8001B8C56/$File/81460_2004-05.pdf.
14. Ström L, Pettersson R, Andersson G. A controlled trial of self-help treatment of recurrent headache conducted via the Internet. J Consult Clin Psychol. 2000 Aug;68(4):722–7. doi: 10.1037/0022-006X.68.4.722. [PubMed] [Cross Ref]
15. Ritterband Lee M, Cox Daniel J, Walker Lynn S, Kovatchev Boris, McKnight Lela, Patel Kushal, Borowitz Stephen, Sutphen James. An Internet intervention as adjunctive therapy for pediatric encopresis. J Consult Clin Psychol. 2003 Oct;71(5):910–7. doi: 10.1037/0022-006X.71.5.910.2003-07816-008 [PubMed] [Cross Ref]
16. Andersson Gerhard, Strömgren Tryggve, Ström Lars, Lyttkens Leif. Randomized controlled trial of internet-based cognitive behavior therapy for distress associated with tinnitus. Psychosom Med. 2002 Sep;64(5):810–6. doi: 10.1097/01.PSY.0000031577.42041.F8. http://www.psychosomaticmedicine.org/cgi/pmidlookup?view=long&pmid=12271112. [PubMed] [Cross Ref]
17. Christensen Helen, Griffiths Kathleen M, Jorm Anthony F. Delivering interventions for depression by using the internet: randomised controlled trial. BMJ. 2004 Jan 31;328(7434):265. doi: 10.1136/bmj.37945.566632.EE. http://bmj.com/cgi/pmidlookup?view=long&pmid=14742346.bmj.37945.566632.EE [PMC free article] [PubMed] [Cross Ref]
18. Litz BT, Williams L, Wang J, Bryant R, Engel CCJ. A therapist-assisted Internet self-help program for traumatic stress. Prof Psychol Res Pr. 2004 Dec;35(6):628–634. doi: 10.1037/0735-7028.35.6.628. [Cross Ref]
19. Gorman J M, Coplan J D. Comorbidity of depression and panic disorder. J Clin Psychiatry. 1996;57 Suppl 10:34–41; discussion 42-3. [PubMed]
20. Hirschfeld R M. Panic disorder: diagnosis, epidemiology, and clinical course. J Clin Psychiatry. 1996;57 Suppl 10:3–8; discussion 9-10. [PubMed]
21. Roy-Byrne P, Katon W, Broadhead W E, Lepine J P, Richards J, Brantley P J, Russo J, Zinbarg R, Barlow D, Liebowitz M. Subsyndromal ("mixed") anxiety--depression in primary care. J Gen Intern Med. 1994 Sep;9(9):507–12. doi: 10.1007/BF02599221. [PubMed] [Cross Ref]
22. Gould RA, Ott MW, Pollack MH. A meta-analysis of treatment outcome for panic disorder. Clin Psychol Rev. 1995;15(8):819–844. doi: 10.1016/0272-7358(95)00048-8. [Cross Ref]
23. McLean P D, Woody S, Taylor S, Koch W J. Comorbid panic disorder and major depression: implications for cognitive-behavioral therapy. J Consult Clin Psychol. 1998 Apr;66(2):240–7. doi: 10.1037/0022-006X.66.2.240. [PubMed] [Cross Ref]
24. Wade W A, Treat T A, Stuart G L. Transporting an empirically supported treatment for panic disorder to a service clinic setting: a benchmarking strategy. J Consult Clin Psychol. 1998 Apr;66(2):231–9. doi: 10.1037/0022-006X.66.2.231. [PubMed] [Cross Ref]
25. Lovell K, Richards D. Multiple access points and levels of entry (MAPLE): ensuring choice, accessibility and equity for CBT services. Behav Cognit Psychother. 2000;28:379–391.
26. Jackson H, Judd F, Komitt A, Fraser C, Murray G, Robins G, Pattison P, Wearing A. Mental health problems in rural contexts: what are the barriers to seeking help from professional providers? Aust Psychol. 2007;42(2):147–160. doi: 10.1080/00050060701299532. [Cross Ref]
27. Thompson Anna, Hunt Caroline, Issakidis Cathy. Why wait? Reasons for delay and prompts to seek help for mental health problems in an Australian clinical sample. Soc Psychiatry Psychiatr Epidemiol. 2004 Oct;39(10):810–7. [PubMed]
28. Parslow R A, Jorm A F. Who uses mental health services in Australia? An analysis of data from the National Survey of Mental Health and Wellbeing. Aust N Z J Psychiatry. 2000 Dec;34(6):997–1008. [PubMed]
29. Carlbring Per, Ekselius Lisa, Andersson Gerhard. Treatment of panic disorder via the Internet: a randomized trial of CBT vs. applied relaxation. J Behav Ther Exp Psychiatry. 2003 Jun;34(2):129–40. doi: 10.1016/S0005-7916(03)00026-0.S0005791603000260 [PubMed] [Cross Ref]
30. Carlbring Per, Nilsson-Ihrfelt Elisabeth, Waara Johan, Kollenstam Cecilia, Buhrman Monica, Kaldo Viktor, Söderberg Marie, Ekselius Lisa, Andersson Gerhard. Treatment of panic disorder: live therapy vs. self-help via the Internet. Behav Res Ther. 2005 Oct;43(10):1321–33. doi: 10.1016/j.brat.2004.10.002.S0005-7967(04)00237-2 [PubMed] [Cross Ref]
31. Carlbring Per, Bohman Susanna, Brunt Sara, Buhrman Monica, Westling Bengt E, Ekselius Lisa, Andersson Gerhard. Remote treatment of panic disorder: a randomized trial of internet-based cognitive behavior therapy supplemented with telephone calls. Am J Psychiatry. 2006 Dec;163(12):2119–25. doi: 10.1176/appi.ajp.163.12.2119. http://ajp.psychiatryonline.org/cgi/pmidlookup?view=long&pmid=17151163.163/12/2119 [PubMed] [Cross Ref]
32. Kenwright Mark, Marks Isaac M. Computer-aided self-help for phobia/panic via internet at home: a pilot study. Br J Psychiatry. 2004 May;184(5):448–9. doi: 10.1192/bjp.184.5.448. http://bjp.rcpsych.org/cgi/pmidlookup?view=long&pmid=15123511. [PubMed] [Cross Ref]
33. Klein Britt, Richards Jeffrey C, Austin David W. Efficacy of internet therapy for panic disorder. J Behav Ther Exp Psychiatry. 2006 Sep;37(3):213–38. doi: 10.1016/j.jbtep.2005.07.001.S0005-7916(05)00045-5 [PubMed] [Cross Ref]
34. Richards J, Klein B, Austin D. Internet CBT for panic disorder: Does the inclusion of stress management information improve end-state functioning? Clin Psychol. 2006;10(1):2–15. doi: 10.1080/13284200500378795. [Cross Ref]
35. Richards Jeffrey, Klein Britt, Carlbring Per. Internet-based treatment for panic disorder. Cogn Behav Ther. 2003;32(3):125–35. doi: 10.1080/16506070302318.YRH61JB77RFLKED7 [PubMed] [Cross Ref]
36. Mihalopoulos C, Kiropoulos L, Shih S, Gunn J, Blashki G, Meadows G. Exploratory economic analyses of three primary care mental health projects: Implications for sustainability. Med J Aust. 2005;183:73–76. [PubMed]
37. National Institute of Clinical Studies (NICS), authors The Impact of the Internet on Consumers Health Behaviour. Centre for General Practice and the Centre for Evidence Based Practice. Melbourne, Australia: NICS; 2003. [2008 Jan 23]. webcite url:http://www.nhmrc.gov.au/nics/data/mediacache/15746001153874589315/The%20Impact%20of%20the%20Internet%20on%20Consumers%20Health%20Behaviour.pdf.
38. Spek Viola, Cuijpers Pim, Nyklícek Ivan, Riper Heleen, Keyzer Jules, Pop Victor. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med. 2007 Mar;37(3):319–28. doi: 10.1017/S0033291706008944.S0033291706008944 [PubMed] [Cross Ref]
39. Pier C, Austin DW, Klein B, Mitchell J, Schattner P, Ciechomski L, Gilson K J, Pierce D, Shandley K, Wade V. A controlled trial of Internet-based cognitive behavioural therapy for panic disorder with face-to-face support from a general practitioner or email support from a psychologist. Ment Health Fam Med. fortcoming. [PMC free article] [PubMed]
40. Austin DW, Carlbring P, Richards JC, Andersson G. Internet administration of three commonly used questionnaires in panic research: equivalence to paper administration in Australian and Swedish samples of people with panic disorder. Int J Testing. 2006;6(1):25. doi: 10.1207/s15327574ijt0601_2. [Cross Ref]
41. Carlbring P, Brunt S, Bohman S, Austin D, Richards J, Andersson G. Ost L-G, authors. Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobia research. Comput Human Behav. 2007;23(3):1421–1434. doi: 10.1016/j.chb.2005.05.002. [Cross Ref]
42. Brown T A, Di Nardo P A, Lehman C L, Campbell L A. Reliability of DSM-IV anxiety and mood disorders: implications for the classification of emotional disorders. J Abnorm Psychol. 2001 Feb;110(1):49–58. doi: 10.1037/0021-843X.110.1.49. [PubMed] [Cross Ref]
43. Taylor S, Cox B J. Anxiety sensitivity: multiple dimensions and hierarchic structure. Behav Res Ther. 1998 Jan;36(1):37–51. doi: 10.1016/S0005-7967(97)00071-5.S0005-7967(97)00071-5 [PubMed] [Cross Ref]
44. Lovibond P F, Lovibond S H. The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav Res Ther. 1995 Mar;33(3):335–43. doi: 10.1016/0005-7967(94)00075-U.0005-7967(94)00075-U [PubMed] [Cross Ref]
45. Chambless D L, Caputo G C, Jasin S E, Gracely E J, Williams C. The Mobility Inventory for Agoraphobia. Behav Res Ther. 1985;23(1):35–44. doi: 10.1016/0005-7967(85)90140-8.0005-7967(85)90140-8 [PubMed] [Cross Ref]
46. Cox B J, Swinson R P, Kuch K, Reichman J T. Dimensions of agoraphobia assessed by the Mobility Inventory. Behav Res Ther. 1993 May;31(4):427–31. doi: 10.1016/0005-7967(93)90102-Z.0005-7967(93)90102-Z [PubMed] [Cross Ref]
47. Craske MG, Rachman SJ, Tallman K. Mobility, cognitions, and panic. J Psychopathol Behav Assess. 1986;8(3):199–210. doi: 10.1007/BF00959832. [Cross Ref]
48. Kwan S M, Evans L. Factor structure of the Mobility Inventory for agoraphobia: a validational study with Australian samples of agoraphobic patients. J Psychopathol Behav Assess. 1990;12(4):365–374. doi: 10.1007/BF00965990. [Cross Ref]
49. Shear M K, Brown T A, Barlow D H, Money R, Sholomskas D E, Woods S W, Gorman J M, Papp L A. Multicenter collaborative panic disorder severity scale. Am J Psychiatry. 1997 Nov;154(11):1571–5. [PubMed]
50. Borkovec TD, Nau SD. Credibility of analogue therapy rationales. J Behav Ther Exp Psychiatry. 1972;3(4):257–260. doi: 10.1016/0005-7916(72)90045-6. [Cross Ref]
51. The WHOQOL Group, authors. Development of the World Health Organisation WHOQOL-BREF quality of life assessment. Psychol Med. 1998;28(3):551–558. doi: 10.1017/S0033291798006667. [PubMed] [Cross Ref]
52. American Psychiatric Association, authors. Diagnostic and Statistical Manual of Mental Disorders. 4th edition. Washington, DC: American Psychiatric Press, Inc; 2000.
53. Proudfoot J, Goldberg D, Mann A, Everitt B, Marks I, Gray J A. Computerized, interactive, multimedia cognitive-behavioural program for anxiety and depression in general practice. Psychol Med. 2003 Feb;33(2):217–27. doi: 10.1017/S0033291702007225. [PubMed] [Cross Ref]
54. Cavanagh K, Shapiro D A, Van Den Berg S, Swain S, Barkham M, Proudfoot J. The effectiveness of computerized cognitive behavioural therapy in routine care. Br J Clin Psychol. 2006 Nov;45(Pt 4):499–514. doi: 10.1348/014466505X84782. [PubMed] [Cross Ref]
55. Cloos Jean-Marc. The treatment of panic disorder. Curr Opin Psychiatry. 2005 Jan;18(1):45–50.00001504-200501000-00009 [PubMed]
56. Dannon Pinhas N, Iancu Iulian, Cohen Ami, Lowengrub Katherine, Grunhaus Leon, Kotler Moshe. Three year naturalistic outcome study of panic disorder patients treated with paroxetine. BMC Psychiatry http://www.biomedcentral.com/1471-244X/4/16. 2004;4:16. doi: 10.1186/1471-244X-4-16.1471-244X-4-16 [PMC free article] [PubMed] [Cross Ref]
57. Choy Yujuan, Peselow Eric D, Case Brady G, Pressman Mary Ann, Luff Jamie A, Laje Gonzalo, Paizis Mary, Ying Patrick, Guardino Mary T. Three-year medication prophylaxis in panic disorder: to continue or discontinue? A naturalistic study. Compr Psychiatry. 2007;48(5):419–25. doi: 10.1016/j.comppsych.2007.04.003.S0010-440X(07)00048-X [PubMed] [Cross Ref]
58. Austin David, Pier Ciaran, Mitchell Joanna, Schattner Peter, Wade Victoria, Pierce David, Klein Britt. Do GPs use electronic mental health resources? - a qualitative study. Aust Fam Physician. 2006 May;35(5):365–6. http://www.racgp.org.au/afp/200605/5881. [PubMed]

Articles from Journal of Medical Internet Research are provided here courtesy of Gunther Eysenbach

Save items

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...


  • Cited in Books
    Cited in Books
    PubMed Central articles cited in books
  • Compound
    PubChem Compound links
  • MedGen
    Related information in MedGen
  • PubMed
    PubMed citations for these articles
  • Substance
    PubChem Substance links

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...