Effectiveness of Online Collaborative Care for Treating Mood and Anxiety Disorders in Primary Care: A Randomized Clinical Trial

By Bruce L. Rollman, Bea Herbeck Belnap, Biol Hum, Kaleab Z. Abebe

Key Points

Questions  Is combining an internet support group (ISG) with a care manager–guided computerized cognitive behavioral therapy (CCBT) program better at treating depression and anxiety than CCBT alone and better than primary care physicians’ usual care for these conditions?

Findings  Among 704 patients randomized to CCBT+ISG, CCBT alone, or their primary care physicians’ usual care, patients in the CCBT+ISG and CCBT alone cohorts reported similar improvements in mental health–related quality of life, mood, and anxiety symptoms, while patients in the CCBT alone cohort reported greater improvements in mood and anxiety than usual care.

Meaning  Providing moderated access to ISG provided no measurable benefit at treating depression and anxiety over care manager–supported CCBT; however, care manager–supported CCBT was more effective than primary care physicians’ usual care for these conditions.


Importance  Collaborative care for depression and anxiety is superior to usual care from primary care physicians for these conditions; however, challenges limit its provision in routine practice and at scale. Advances in technology may overcome these barriers but have yet to be tested.

Objective  To examine the effectiveness of combining an internet support group (ISG) with an online computerized cognitive behavioral therapy (CCBT) provided via a collaborative care program for treating depression and anxiety vs CCBT alone and whether providing CCBT in this manner is more effective than usual care.

Design, Setting, and Participants  In this 3-arm randomized clinical trial with blinded outcome assessments, primary care physicians from 26 primary care practices in Pittsburgh, Pennsylvania, referred 2884 patients aged 18 to 75 years in response to an electronic medical record prompt from August 2012 to September 2014. Overall, 704 patients (24.4%) met all eligibility criteria and were randomized to CCBT alone (n = 301), CCBT+ISG (n = 302), or usual care (n = 101). Intent-to-treat analyses were conducted November 2015 to January 2017.

Interventions  Six months of guided access to an 8-session CCBT program provided by care managers who informed primary care physicians of their patients’ progress and promoted patient engagement with our online programs.

Main Outcomes and Measures  Mental health–related quality of life (12-Item Short-Form Health Survey Mental Health Composite Scale) and depression and anxiety symptoms (Patient-Reported Outcomes Measurement Information System) at 6-month follow-up, with treatment durability assessed 6 months later.

Results  Of the 704 randomized patients, 562 patients (79.8%) were female, and the mean (SD) age was 42.7 (14.3) years. A total of 604 patients (85.8%) completed our primary 6-month outcome assessment. At 6-month assessment, 254 of 301 patients (84.4%) receiving CCBT alone started the program (mean [SD] sessions completed, 5.4 [2.8]), and 228 of 302 patients (75.5%) in the CCBT+ISG cohort logged into the ISG at least once, of whom 141 (61.8%) provided 1 or more comments or posts (mean, 10.5; median [range], 3 [1-306]). Patients receiving CCBT+ISG reported similar 6-month improvements in mental health–related quality of life, mood, and anxiety symptoms compared with patients receiving CCBT alone. However, compared with patients receiving usual care, patients in the CCBT alone cohort reported significant 6-month effect size improvements in mood (effect size, 0.31; 95% CI, 0.09-0.53) and anxiety (effect size, 0.26; 95% CI, 0.05-0.48) that persisted 6 months later, and completing more CCBT sessions produced greater effect size improvements in mental health–related quality of life and symptoms.

Conclusions and Relevance  While providing moderated access to an ISG provided no additional benefit over guided CCBT at improving mental health–related quality of life, mood, and anxiety symptoms, guided CCBT alone is more effective than usual care for these conditions.


Study Setting

Using a protocol approved by the University of Pittsburgh Institutional Review Board, our single-center trial recruited patients from 26 primary care offices that shared a common electronic medical record (EMR) (Epic). Informed written consent was obtained from all participants.


We exposed PCPs to an EMR “Best Practice Alert” reminder about our study at the time of the clinical encounter.15 It launched automatically for all patients aged 18 to 75 years whenever anxiety, generalized anxiety, panic, or depression was entered as an encounter diagnosis. If the patient agreed to a referral, the PCP electronically “signed” the alert, which forwarded the patient’s name to a study recruiter who then called the patient by telephone to review protocol eligibility.

Eligible patients needed to have internet and email access; a score of 10 or greater on either the 7-Item Generalized Anxiety Disorder scale (GAD-7)16 or the 9-Item Patient Health Questionnaire (PHQ-9)17; and no alcohol dependence as determined by the Alcohol Use Disorders Identification Test,18 active suicidality, or other serious mental illness for which our interventions may be inappropriate. If confirmed, the recruiter reviewed a mailed consent form and obtained the patients’ signed consent on a recorded telephone line. Afterwards, they administered the 12-Item Short-Form Health Survey (SF-12) to determine health-related quality of life,19 the fixed-length Patient-Reported Outcomes Measurement Information System (PROMIS) depression and anxiety measures to assess mood and anxiety symptoms,20 and the Primary Care Evaluation of Mental Disorders to provide an anxiety and mood disorder diagnosis,21 and collected information on patients’ self-reported race/ethnicity, sex, and other sociodemographic characteristics.

Randomization Procedure

Following the baseline assessment, we randomized patients in a 3:3:1 ratio to (1) care manager–guided CCBT (CCBT alone), (2) care manager–guided access to both CCBT and our ISG (CCBT+ISG), or (3) usual care (UC) under their PCP. We stratified randomization by practice size and age group using randomly permuted blocks according to a computer-generated assignment sequence prepared in advance by our study statistician and concealed until after the baseline assessment. Afterwards, we informed all patients of their treatment assignment and notified their referring PCP.

Usual Care

For ethical reasons,22 we informed patients receiving UC of their mood and anxiety symptoms and their referring PCP. However, we provided no treatment advice unless we detected suicidality or a 25% worsening of symptoms from baseline on a follow-up assessment.


We employed college graduates with mental health research experience as care managers and assigned each exclusively to one intervention arm. We first prepared them in a basic understanding of mood and anxiety disorders, our pharmacotherapy algorithm,23 CCBT program, and tracking registry and later reinforced this training in our weekly case review sessions.

Computerized Cognitive Behavioral Therapy

We used the Beating the Blues CCBT program, which has been proven to be effective.24,25 It consists of a 10-minute introductory video followed by eight 50-minute interactive sessions that our care managers encouraged patients to complete every 1 to 2 weeks. Each session used easily understood text, audiovisual clips, and “homework” assignments to impart basic CBT techniques, and patients completed the GAD-7 and PHQ-9 at the start of each CCBT session to self-track their symptoms (eMethods in Supplement 2).

Internet Support Group

We used WordPress software to create our password-protected ISG that patients could access via computer or smartphone (eFigure 1 in Supplement 2). In addition to a variety of discussion boards created by the care manager moderator and study patients, the ISG curated links to external resources, including local $4 generic pharmacy programs, “find-a-therapist” and various crisis hotlines, and brief YouTube videos on insomnia, nutrition, exercise, and other topics, and we embedded links to our EMR’s patient portal to integrate its use into routine care. To enhance patient engagement, we featured (1) status indicators on members’ profiles and comments (eg, stars and “likes”), (2) email notifications of new ISG activities, (3) automated highlighting of recent comments on members’ home pages personalized to their ISG profile and past activities, (4) invited member-guest moderators, and (5) various contests to encourage log-ins and comments.

To preserve confidentiality, we assigned members’ user names, encouraged them to select a representative avatar (eg, a sunrise or animal), and sent reminders not to post self-identifying information. For additional safety, an investigator logged into the ISG daily to review new posts for suicidal thoughts and other potentially inappropriate content, and we allowed members to flag comments for potential removal.

Care Manager Contacts

Care managers emailed their assigned patients a web link to the CCBT program and, if applicable, the ISG and requested a time to schedule an introductory telephone call to review the program(s) and establish rapport. Later, they logged into the CCBT program’s clinical helper portal to monitor their patients’ progress (eg, sessions completed, self-reported symptoms, and problems they chose to address), sent personalized feedback and encouragement via email, and contacted patients via telephone who either had not improved or failed to log in regularly.

Case Review and Follow-up

Care managers presented their patients to the study PCP, psychiatrist, and project coordinator in weekly 60-minute case review sessions split by intervention arm. To efficiently focus our time, we developed an electronic registry that could sort patients by randomization date, last contact, and highest PHQ-9 or GAD-7 score (eMethods in Supplement 2). In addition to conveying general lifestyle adjustments, including exercise and social engagement, we recommended antidepressant/anxiolytic pharmacotherapy based on patients’ treatment preferences and response to CCBT as well as referrals to mental health specialists when they did not improve or had complex psychosocial issues.23

Depending on a patient’s symptoms and level of engagement, the care manager emailed or telephoned biweekly for approximately 2 months, and these contacts lasted approximately 15 to 30 minutes. Afterwards, the patient transitioned to the continuation phase of care, during which the care manager contacted the patient approximately monthly until the end of our 6-month intervention. Given our collaborative care framework, we provided PCPs with our treatment recommendations and regular updates of their patients’ progress via EMR.


Patients, PCPs, and care managers were not blinded to their treatment assignment. Therefore, we employed several blinded assessors to determine the effectiveness of our interventions. They contacted patients by telephone to administer our assessment battery at 3-month, 6-month, and 12-month follow-up and later sent patients $15 after each completed assessment for their time (up to $60).

We trained our assessors using audiotapes, manuals, and practice interviews and used a computer-assisted telephone interview system to guide them through each assessment. We digitally recorded these calls and conducted periodic spot checks to confirm responses were rated accurately and corresponded with those entered into our study database, reviewed interactions with suicidal patients, and provided staff with feedback on their performance. Later, we abstracted data from the EMR to collect information on patients’ medical conditions and health services use, our server logs to measure engagement with the CCBT and ISG programs, and our care managers’ electronic registry to document the number of email and telephone contacts.

Data and Safety Monitoring

We programmed our computer-assisted telephone interview system to identify patients receiving UC whose blinded PROMIS score increased by 25% or more above baseline. Following a review, we notified their PCP via EMR and offered treatment advice. Whenever our care managers or assessors encountered suicidality, either expressed spontaneously or on routine administration of our measures, our computer-assisted telephone interview system automatically launched our Suicide Risk Management Protocol that provided triage advice.26 The CCBT program also notified the care manager whenever a patient endorsed suicidality on the PHQ-9 administered at each session. Finally, an independent external data and safety monitoring board appointed by our funding agency monitored the progress and safety of our trial.

Statistical Analysis

We powered our trial to test the primary hypothesis that patients receiving CCBT+ISG will report 0.30 or greater effect size (ES) improvement from baseline at 6 months on the SF-12 Mental Health Composite Scale (MCS) vs CCBT alone. Assuming a 2-sample t test to compare between-arm differences in 6-month improvements and 2-tailed α = .05, we needed 300 patients per arm to have 90% or greater power to detect a 0.30 ES difference in our primary outcome measure.

We compared baseline sociodemographic and clinical characteristics by randomization status using t tests for continuous data and χ2 analyses for categorical data. Our primary intent-to-treat analyses included all randomized participants regardless of adherence to their assigned treatment. We used linear mixed models27 that included fixed effects for time, study arm, time-by-study arm, age strata, practice size, and random effects for patients. We considered time as a categorical variable because of the assumption of nonlinearity over time. To test our hypotheses, we used contrasts to estimate the adjusted mean difference between study arms in the 6-month improvement of SF-12 MCS and PROMIS measures (secondary outcomes) and 6 months later to assess treatment durability. Additionally, we calculated ESs for 6-month changes in SF-12 with 95% CIs by (1) prespecified subgroups of age group, sex, race/ethnicity, baseline symptom severity, and practice size and (2) unplanned subgroups of education and living alone status. We considered a significant 3-way interaction between time, study arm, and the potential covariate as a significant subgroup effect and used Poisson regression to compare rates of PCP contacts, emergency department visits, and hospitalizations between study arms.

We investigated a potential dose response between the number of CCBT sessions completed within our CCBT alone and UC study arms using the same linear mixed model described earlier but parametrizing the CCBT alone arm by assigning each patient a value equal to the proportion completed of the 8-session program. Finally, we conducted exploratory post hoc per-protocol analyses restricted to those who completed 4 or more and all 8 CCBT sessions.

Every effort was made to identify the mechanism of missing data. We compared participants who withdrew from study participation by baseline covariates and analyzed time until withdrawal by study arm using Kaplan-Meier curves.28 Our linear mixed models for our primary analyses assumed that data were missing at random and were robust to ignorable missingness assumptions.29 All reported P values are 2-tailed with significance levels at P ≤ .05, and all analyses were performed with SAS version 9.4 (SAS Institute).


From August 2012 to September 2014, PCPs referred 2884 patients in response to our EMR prompt. Of these, 704 (24.4%) met all eligibility criteria, provided informed consent, and were randomized (Figure 1). Their baseline sociodemographic and clinical characteristics (Table 1) and completion rate of follow-up assessments at both 6 months (604 [85.8%]) and 12 months (593 [84.2%]) were similar by randomization status (Figure 1), and we found no differences in the sociodemographic and clinical characteristics between participants who withdrew and those who did not.

Intervention Engagement

By 6 months, 504 of 603 patients (83.6%) with CCBT access had completed at least 1 session and 221 (36.7%) had completed all 8, and the mean sessions completed was 5.4, which was similar by randomization status (Table 2), sex, race/ethnicity, and age strata (eTable 1 in Supplement 2). Overall, 228 of 302 patients (75.5%) in the CCBT+ISG arm logged into the ISG at least once, of whom 141 (61.8%) made at least 1 online comment or post (mean, 10.5; median, 3; range, 1-306) (Table 2) (eFigure 2 in Supplement 2).

Primary Hypothesis: CCBT+ISG vs CCBT Alone

At 6-month follow-up, patients in the CCBT+ISG and CCBT alone arms reported similar improvements on our primary outcome measure (SF-12 MCS: ES, 0.02; 95% CI, −0.17 to 0.13) and on the PROMIS Depression and Anxiety scales that continued 6 months later (Figure 2). We also identified a significant treatment interaction favoring CCBT+ISG for patients aged 60 to 75 years on the SF-12 MCS (Figure 3) (eFigure 3 in Supplement 2) and CCBT alone for patients aged 35 to 59 years on the PROMIS Depression and Anxiety scales (eFigure 4 in Supplement 2).

Secondary Hypothesis: CCBT Alone vs UC

Compared with patients in the UC arm, patients in the CCBT alone arm reported significant 6-month improvements on the PROMIS Depression and Anxiety scales (eFigure 4 in Supplement 2) but not the SF-12 MCS scale (Figure 2). However, these differences resolved 6 months later, as patients’ symptoms in the UC arm improved. Again, we observed significant treatment interactions favoring CCBT for patients aged 35 to 59 years on the SF-12 MCS (eFigure 3 in Supplement 2) and PROMIS Depression and Anxiety scales (eFigure 4 in Supplement 2), for patients living alone on the PROMIS Depression and Anxiety scales, and for nonwhite patients on the PROMIS Depression scale (eFigure 4 in Supplement 2). Moreover, patients reported improved 6-month SF-12 MCS (mean points, 0.80; 95% CI, 0.37-1.22), PROMIS Depression (mean points, 0.48; 95% CI, −0.76 to −0.19), and PROMIS Anxiety (mean points, 0.48; 95% CI, −0.79 to −0.17) scores for each additional CCBT session completed, and per-protocol analyses revealed a similar pattern (PROMIS mood symptoms: patients who completed ≥4 sessions: ES, 0.41; 95% CI, 0.17-0.65; patients who completed all 8 sessions: ES, 0.52; 95% CI, 0.26-0.78) (eTable 2 in Supplement 2).

6-Month Health Services Use

Primary care physicians and care manager contacts with patients via telephone and email were similar by intervention arm (Table 2). Moreover, patients receiving UC and intervention had similar rates of PCP contacts, use of antidepressant and anxiolytic pharmacotherapy, and visits to mental health specialists, emergency departments, and hospitals (Table 2).


To our knowledge, this is the first trial to examine the effectiveness of incorporating either CCBT or an ISG into a collaborative care program for treating depression or anxiety in primary care. Our report confirms the effectiveness of guided CCBT, highlights the critical importance of patient engagement with online interventions, and provides high-quality evidence about the limits and potential benefits of these emerging technologies.

Few trials have evaluated the psychologic benefits of ISGs, and none were linked to patients’ usual source of primary care as ours was.7,30– 32 Perhaps most comparable with our trial is the trial by Griffiths et al,31 who randomized 478 adults with elevated depressive symptoms to either a moderated ISG, an online psychotherapy program, both interventions, or to a UC control. They too found their combined ISG and online psychotherapy interventions improved mood symptoms vs UC and no benefit from their ISG beyond UC. However, engagement was low, as only 62% of patients in the ISG group logged into the site, only 15% created 1 or more ISG posts, and those assigned to the ISG arm were more likely than patients in the UC arm to miss a blinded telephone assessment (52% vs 34% at 12 months).31 These findings as well as other reports33 add to our understanding of the challenges in sustaining patient engagement with online interventions to improve clinical outcomes.34,35

Unlike our earlier collaborative care trials, where care managers assigned patients homework lessons in printed workbooks,36– 38 the CCBT program enabled our care managers to unobtrusively monitor their patients’ engagement with treatment while providing similarly effective care to a doubled caseload (90 to 100 patients).36,38 Although the ES improvements we obtained were smaller than those described in meta-analyses of “supported” CCBT (major depression: ES, 0.78; 95% CI, 0.59-0.964), we identified a dose effect that confirms the importance of patient engagement.39 Indeed, Gilbody et al40 reported in 2015 no differences in mood symptoms among 691 patients with depression in primary care they randomized to either Beating the Blues or MoodGYM (HealthMed) CCBT programs41or usual care from their PCPs. Similar to our protocol, their study staff contacted patients by telephone to promote use of their programs; however, they did not monitor patients’ symptoms or send recommendations to PCPs as we did, and patient adherence with both CCBT programs was low (median sessions completed, <2).40

Given our findings and other recent reports,3– 5 we anticipate more engaging and powerful CCBT programs better tailored to patients’ specific needs, sociodemographic characteristics, medical conditions, and cultural and linguistic preferences that are integrated into the EMR for documentation and billing purposes will become widely deployed over the next decade. Finally, while we were unable to demonstrate a measurable benefit from our ISG, we remain optimistic that more engaging ISGs that apply machine learning algorithms to EMR and claims data to present patients with more personalized information in real time will soon be tested by health care organizations experimenting with social media.42,43


Our study has limitations, several of which potentially affect the generalizability of our findings. First, our use of EMR-generated prompts to promote identification of patients for study participation is limited to settings with systems capable of generating these alerts, clinician recognition of targeted conditions, and entry of the proper diagnostic codes into the EMR. Second, we relied on 1 CCBT and ISG, and others using different programs and levels of human support to promote adherence may obtain different outcomes. Third, because we lacked information on symptom duration, patients with long-term mild mood and anxiety symptoms may have similar outcomes as those with severe acute symptoms. Fourth, given the nature of our interventions, patients knew their treatment assignment, which could have biased their responses to our blinded assessors. Finally, study sites were not cluster randomized, and the same physicians cared for patients in all study arms. Although this could have diminished outcome differences between treatment arms, we observed similar ES improvements as previous collaborative care trials.1


In summary, although our ISG did not produce any measurable benefit over CCBT alone, providing online CCBT to patients with depression and anxiety receiving primary care via a centralized collaborative care program is an effective strategy for delivering mental health care at scale. Our study findings have important implications for transforming the way mental health care is delivered in primary care and focus further attention to the emerging field of e–mental health.




Archer  J, Bower  P, Gilbody  S,  et al.  Collaborative care for depression and anxiety problems.  Cochrane Database Syst Rev. 2012;10(10):CD006525.PubMedGoogle Scholar


Katon  W, Unützer  J, Wells  K, Jones  L.  Collaborative depression care: history, evolution and ways to enhance dissemination and sustainability.  Gen Hosp Psychiatry. 2010;32(5):456-464.PubMedGoogle ScholarCrossref


Andersson  G, Cuijpers  P, Carlbring  P, Riper  H, Hedman  E.  Guided internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis.  World Psychiatry. 2014;13(3):288-295.PubMedGoogle ScholarCrossref


Andrews  G, Cuijpers  P, Craske  MG, McEvoy  P, Titov  N.  Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis.  PLoS One. 2010;5(10):e13196.PubMedGoogle ScholarCrossref


Karyotaki  E, Riper  H, Twisk  J,  et al.  Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data.  JAMA Psychiatry. 2017;74(4):351-359.PubMedGoogle ScholarCrossref


Rosenberg  T. Depressed? Try Therapy Without the Therapist. New York Times. June 19, 2015.https://opinionator.blogs.nytimes.com/2015/06/19/depressed-try-therapy-without-the-therapist/?mcubz=0. Accessed October 5, 2017.


Griffiths  KM, Calear  AL, Banfield  M, Tam  A.  Systematic review on internet support groups (ISGs) and depression (2): what is known about depression ISGs?  J Med Internet Res. 2009;11(3):e41.PubMedGoogle ScholarCrossref


Fox  S, Purcell  K. Chronic disease and the internet. http://www.pewinternet.org/2010/03/24/chronic-disease-and-the-internet/. Accessed October 5, 2017.


Frost  J, Massagli  M.  PatientsLikeMe the case for a data-centered patient community and how ALS patients use the community to inform treatment decisions and manage pulmonary health.  Chron Respir Dis. 2009;6(4):225-229.PubMedGoogle ScholarCrossref


Rotondi  AJ, Anderson  CM, Haas  GL,  et al.  Web-based psychoeducational intervention for persons with schizophrenia and their supporters: one-year outcomes.  Psychiatr Serv. 2010;61(11):1099-1105.PubMedGoogle ScholarCrossref


Houston  TK, Cooper  LA, Ford  DE.  Internet support groups for depression: a 1-year prospective cohort study.  Am J Psychiatry. 2002;159(12):2062-2068.PubMedGoogle ScholarCrossref


deBronkart  D.  How the e-patient community helped save my life: an essay by Dave deBronkart.  BMJ. 2013;346:f1990.PubMedGoogle ScholarCrossref


Merolli  M, Gray  K, Martin-Sanchez  F.  Health outcomes and related effects of using social media in chronic disease management: a literature review and analysis of affordances.  J Biomed Inform. 2013;46(6):957-969.PubMedGoogle ScholarCrossref


Mohr  DC, Burns  MN, Schueller  SM, Clarke  G, Klinkman  M.  Behavioral intervention technologies: evidence review and recommendations for future research in mental health.  Gen Hosp Psychiatry. 2013;35(4):332-338.PubMedGoogle ScholarCrossref


Rollman  BL, Fischer  GS, Zhu  F, Belnap  BH.  Comparison of electronic physician prompts versus waitroom case-finding on clinical trial enrollment.  J Gen Intern Med. 2008;23(4):447-450.PubMedGoogle ScholarCrossref


Spitzer  RL, Kroenke  K, Williams  JB, Löwe  B.  A brief measure for assessing generalized anxiety disorder: the GAD-7.  Arch Intern Med. 2006;166(10):1092-1097.PubMedGoogle ScholarCrossref


Kroenke  K, Spitzer  RL, Williams  JB.  The PHQ-9: validity of a brief depression severity measure.  J Gen Intern Med. 2001;16(9):606-613.PubMedGoogle ScholarCrossref


Gordon  AJ, Maisto  SA, McNeil  M,  et al.  Three questions can detect hazardous drinkers.  J Fam Pract. 2001;50(4):313-320.PubMedGoogle Scholar


Ware  J  Jr, Kosinski  M, Keller  SD.  A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity.  Med Care. 1996;34(3):220-233.PubMedGoogle ScholarCrossref


Choi  SW, Reise  SP, Pilkonis  PA, Hays  RD, Cella  D.  Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms.  Qual Life Res. 2010;19(1):125-136.PubMedGoogle ScholarCrossref


Spitzer  RL, Williams  JBW, Kroenke  K,  et al.  Utility of a new procedure for diagnosing mental disorders in primary care: the PRIME-MD 1000 study.  JAMA. 1994;272(22):1749-1756.PubMedGoogle ScholarCrossref


Reynolds  CF  III, Degenholtz  H, Parker  LS,  et al.  Treatment as usual (TAU) control practices in the PROSPECT Study: managing the interaction and tension between research design and ethics.  Int J Geriatr Psychiatry. 2001;16(6):602-608.PubMedGoogle ScholarCrossref


Rollman  BL, Herbeck Belnap  B, Reynolds  CF, Schulberg  HC, Shear  MK.  A contemporary protocol to assist primary care physicians in the treatment of panic and generalized anxiety disorders.  Gen Hosp Psychiatry. 2003;25(2):74-82.PubMedGoogle ScholarCrossref


Kaltenthaler  E, Brazier  J, De Nigris  E,  et al.  Computerised cognitive behaviour therapy for depression and anxiety update: a systematic review and economic evaluation.  Health Technol Assess. 2006;10(33):iii, xi-xiv, 1-168.PubMedGoogle ScholarCrossref


Proudfoot  J, Ryden  C, Everitt  B,  et al.  Clinical efficacy of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial.  Br J Psychiatry. 2004;185:46-54.PubMedGoogle ScholarCrossref


Herbeck Belnap  B, Schulberg  HC, He  F, Mazumdar  S, Reynolds  CF  III, Rollman  BL.  Electronic protocol for suicide risk management in research participants.  J Psychosom Res. 2015;78(4):340-345.PubMedGoogle ScholarCrossref


Laird  NM, Ware  JH.  Random-effects models for longitudinal data.  Biometrics. 1982;38(4):963-974.PubMedGoogle ScholarCrossref


Dziura  JD, Post  LA, Zhao  Q, Fu  Z, Peduzzi  P.  Strategies for dealing with missing data in clinical trials: from design to analysis.  Yale J Biol Med. 2013;86(3):343-358.PubMedGoogle Scholar


Little  RJA, Rubin  DB.  Statistical Analysis with Missing Data. 2nd ed. New York, NY: Wiley; 2002.Crossref


Lorig  KR, Ritter  PL, Laurent  DD, Plant  K.  Internet-based chronic disease self-management: a randomized trial.  Med Care. 2006;44(11):964-971.PubMedGoogle ScholarCrossref


Griffiths  KM, Mackinnon  AJ, Crisp  DA, Christensen  H, Bennett  K, Farrer  L.  The effectiveness of an online support group for members of the community with depression: a randomised controlled trial.  PLoS One. 2012;7(12):e53244.PubMedGoogle ScholarCrossref


Andersson  G, Bergström  J, Holländare  F, Carlbring  P, Kaldo  V, Ekselius  L.  Internet-based self-help for depression: randomised controlled trial.  Br J Psychiatry. 2005;187:456-461.PubMedGoogle ScholarCrossref


Spek  V, Nyklícek  I, Smits  N,  et al.  Internet-based cognitive behavioural therapy for subthreshold depression in people over 50 years old: a randomized controlled clinical trial.  Psychol Med. 2007;37(12):1797-1806.PubMedGoogle ScholarCrossref


Christensen  H, Griffiths  KM, Farrer  L.  Adherence in internet interventions for anxiety and depression.  J Med Internet Res. 2009;11(2):e13.PubMedGoogle ScholarCrossref


Mohr  DC, Cuijpers  P, Lehman  K.  Supportive accountability: a model for providing human support to enhance adherence to eHealth interventions.  J Med Internet Res. 2011;13(1):e30.PubMedGoogle ScholarCrossref


Rollman  BL, Belnap  BH, Mazumdar  S,  et al.  A randomized trial to improve the quality of treatment for panic and generalized anxiety disorders in primary care.  Arch Gen Psychiatry. 2005;62(12):1332-1341.PubMedGoogle ScholarCrossref


Rollman  BL, Belnap  BH, LeMenager  MS,  et al.  Telephone-delivered collaborative care for treating post-CABG depression: a randomized controlled trial.  JAMA. 2009;302(19):2095-2103.PubMedGoogle ScholarCrossref


Rollman  BL, Belnap  BH, Mazumdar  S,  et al.  Telephone-delivered stepped collaborative care for treating anxiety in primary care: a randomized controlled trial.  J Gen Intern Med. 2017;32(3):245-255.PubMedGoogle ScholarCrossref


Spek  V, Cuijpers  P, Nyklícek  I, Riper  H, Keyzer  J, Pop  V.  Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis.  Psychol Med. 2007;37(3):319-328.PubMedGoogle ScholarCrossref


Gilbody  S, Littlewood  E, Hewitt  C,  et al; REEACT Team.  Computerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): large scale pragmatic randomised controlled trial.  BMJ. 2015;351:h5627.PubMedGoogle ScholarCrossref


Christensen  H, Griffiths  KM, Jorm  AF.  Delivering interventions for depression by using the internet: randomised controlled trial.  BMJ. 2004;328(7434):265.PubMedGoogle ScholarCrossref


Rollman  BL, Herbeck Belnap  B, Rotondi  AJ.  Internet support groups for health: ready for the Affordable Care Act.  J Gen Intern Med. 2014;29(11):1436-1438.PubMedGoogle ScholarCrossref


Widmer  RJ, Engler  NB, Geske  JB, Klarich  KW, Timimi  FK.  An academic healthcare twitter account: the Mayo Clinic experience.  Cyberpsychol Behav Soc Netw. 2016;19(6):360-366.PubMedGoogle ScholarCrossref

Trial Registration  clinicaltrials.gov Identifier: NCT01482806

JAMA Psychiatry. Published online November 8, 2017. doi:10.1001/jamapsychiatry.2017.3379
By |2018-06-29T11:18:37+00:00November 13th, 2017|We Know Psychiatry|0 Comments

About the Author:

Leave A Comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.