Published on in Vol 13 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/49660, first published .
Blended Psychological Therapy for the Treatment of Psychological Disorders in Adult Patients: Systematic Review and Meta-Analysis

Blended Psychological Therapy for the Treatment of Psychological Disorders in Adult Patients: Systematic Review and Meta-Analysis

Blended Psychological Therapy for the Treatment of Psychological Disorders in Adult Patients: Systematic Review and Meta-Analysis

Review

1Psycho-Oncology Co-operative Research Group (PoCoG), School of Psychology, The University of Sydney, Sydney, Australia

2Centre for Medical Psychology & Evidence-based Decision-making (CeMPED), School of Psychology, The University of Sydney, Sydney, Australia

3Susan Wakil School of Nursing and Midwifery, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia

4Flinders University, College of Education, Psychology and Social Work, Flinders University Institute of Mental Health and Wellbeing, Adelaide, Australia

Corresponding Author:

Joanne Margaret Shaw, BAppl Sc, BPsych (Hon), PhD

Psycho-Oncology Co-operative Research Group (PoCoG)

School of Psychology

The University of Sydney

Rm 311B Level 3 Griffith Taylor (A19)

Manning Road

Sydney, NSW 2006

Australia

Phone: 61 2 9351 3761

Email: joanne.shaw@sydney.edu.au


Background: Blended therapy (BT) combines digital with face-to-face psychological interventions. BT may improve access to treatment, therapy uptake, and adherence. However, research is scarce on the structure of BT models.

Objective: We synthesized the literature to describe BT models used for the treatment of psychological disorders in adults. We investigated whether BT structure, content, and ratio affected treatment efficacy, uptake, and adherence. We also conducted meta-analyses to examine treatment efficacy in intervention-control dyads and associations between treatment outcomes versus BT model structure.

Methods: PsycINFO, CINAHL, Embase, ProQuest, and MEDLINE databases were searched. Eligibility criteria included articles published in English till March 2023 that described digital and face-to-face elements as part of an intervention plan for treating psychological disorders in adult patients. We developed a coding framework to characterize the BT interventions. A meta-analysis was conducted to calculate effect size (ES; Cohen d and 95% CIs) regarding pre- and posttreatment outcomes in depression and anxiety versus BT structure. The review was registered with PROSPERO and followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines.

Results: Searches identified 8436 articles, and data were extracted from 29 studies. BT interventions were analyzed and classified according to mode of interaction between digital and face-to-face components (integrated vs sequential), role of the components (core vs supplementary), component delivery (alternate vs case-by-case), and digital materials assignment mode (standardized vs personalized). Most BT interventions (n=24) used a cognitive behavioral therapy approach for anxiety or depression treatment. Mean rates of uptake (91%) and adherence (81%) were reported across individual studies. BT interventions were more effective or noninferior to treatment as usual, with large spread in the data and a moderate to large ES in the treatment of depression (n=9; Cohen d=–1.1, 95% CI –0.6 to –1.6, P<.001, and z score=–4.3). A small, nonsignificant ES was found for anxiety outcomes (n=5; Cohen d=–0.1, 95% CI –0.3 to 0.05, P=.17, and z score=–1.4). Higher ESs were found in blended interventions with supplementary design (depression: n=11, Cohen d=–0.75, 95% CI –0.56 to –0.95; anxiety: n=8, Cohen d=–0.9, 95% CI –0.6 to –1.2); fewer (≤6) face-to-face sessions (depression: n=9, Cohen d=–0.7, 95% CI –0.5 to –0.9; anxiety: n=7, Cohen d=–0.8, 95% CI –0.3 to –1.3); and a lower ratio (≤50%) of face-to-face versus digital sessions (depression: n=5, Cohen d=–0.8, 95% CI –0.6 to –1.1; anxiety: n=4, Cohen d=–0.8, 95% CI 0.006 to –1.6).

Conclusions: This study confirmed integrated BT models as feasible to deliver. We found BT to be effective in depression treatment, but anxiety treatment results were nonsignificant. Future studies assessing outcomes across different psychological disorders and therapeutic approaches are required.

Trial Registration: PROSPERO CRD42021258977; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=258977

Interact J Med Res 2024;13:e49660

doi:10.2196/49660

Keywords



The Impact of Psychological Disorders

Psychological disorders affect approximately 1 billion people globally and were responsible for 10% of the prepandemic global burden of disease in 2019, with estimates of the mental health burden increasing [1]. Depression and anxiety disorders cost US $1 trillion per year globally [2]. Evidence-based, effective mental health care is available, but its provision does not reach everyone who needs it [2,3].

Digital (or Online) Therapy

Digital psychological therapy provides an opportunity to enhance patient access to psychological treatment [4,5] and is recommended by the World Health Organization as a cornerstone of “comprehensive, integrated and responsive mental health and social care services” [1]. Research regarding digital therapy has largely focused on internet-delivered cognitive behavioral therapy (CBT), demonstrating its efficacy and cost-effectiveness [6,7], particularly in the treatment of depression and anxiety [8-12]. Although uptake and adherence to digital therapy in the research setting have shown improvement [13], engagement is still low, particularly in routine mental health care [14-17]. In addition, research suggests stakeholder preference for face-to-face interventions [18,19]. A systematic review [20] reported on concerns raised by health professionals about the use of digital therapy alone, including perceived nonsuitability for patients due to symptom severity, lack of digital access and literacy, and perception of digital treatment as being less engaging than face-to-face treatments. This review indicated that blended psychological therapy (also called “blended therapy” or “blended care”) was perceived as a midway option between digital and face-to-face therapy.

Blended Therapy

Blended therapy (BT) is a model of care that combines digital and face-to-face delivery of psychological therapy, integrating benefits from both modalities. Specifically, the face-to-face component is delivered by a mental health professional, such as a psychologist, while the digital component is patient driven [21-23]. Integrating digital therapy with face-to-face interventions in a blended model has the potential to save professionals’ and patients’ time (eg, transport to and from the clinic); increase the frequency of sessions; improve treatment uptake, adherence, and maintenance; and boost therapy effects [24-26].

A systematic review by Erbe et al [24] (N=44) found that BT may improve dropout rates and save health professionals’ time compared with exclusively face-to-face interventions. Despite increasing evidence of the benefits of blended psychological therapy for patients [22,24], there is a lack of research specifically focused on “what, how, where, and when” BT is effective to inform future BT interventions [21,22,27]. The rationale for our systematic review emerges from the scarcity of data specifically focusing on BT processes including BT content and structure, which hinders scientific reproducibility of BT and impacts its implementation success.

Objectives of This Review

Seeking to address these gaps in BT literature, our systematic review and meta-analysis expands on the work of Erbe et al [24] and aims to (1) identify and describe the structure, content, and ratio of the face-to-face and digital components in BT interventions applied for the treatment of psychological disorders and (2) investigate whether there is an association among the structure, content, and ratio of blended components and the treatment efficacy of, uptake of, and adherence to BT.


Design

This review followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) [28] guidelines and was registered with PROSPERO (CRD42021258977). The PRISMA checklist is provided in Multimedia Appendix 1.

Search Strategy

The PsycINFO, CINAHL, Embase, ProQuest, and MEDLINE databases were searched using keywords and Medical Subject Headings terms—“blended”; “online”; “face-to-face”; “treatment”; “therapy”; “care”; “mental disorders”; “psychological distress”; and “psychological disease”—for articles published in English (Multimedia Appendix 2). The search included articles published till May 2022, and an updated search was conducted in March 2023. Reference lists of the included studies were also manually searched.

Study Selection

Inclusion and Exclusion Criteria

Studies that described or applied an intervention where both digital and face-to-face elements were integrated or delivered sequentially were included. We included studies in which the participants were aged ≥18 years and diagnosed with a psychological disorder. Studies solely investigating populations other than this target group (health care professionals, student cohorts, employees, etc) were excluded.

Comparators

The comparator or control groups included treatment as usual (pharmacological or psychological intervention and standard medical care), waitlist, or other interventions.

Data Abstracted

The primary focus was the intervention design, including descriptions of the structure, content, and ratio of the sessions used in each model. Secondary outcomes were (1) a psychological therapy approach used in the BT models, (2) patient groups for which BT was applied, (3) treatment efficacy, (4) uptake and adherence, (5) health service outcomes (eg, cost-effectiveness), (6) patients’ acceptability of BT, (7) therapeutic alliance rates, and (8) barriers and facilitators reported.

Article Screening and Selection

All search results were uploaded into Covidence software [29]. Two reviewers (KFN-Z and JMS) screened the titles and abstracts independently. Full-text reviews based on the eligibility criteria were conducted by KFN-Z and PB or JMS.

Data Extraction

Data extraction was conducted by KFN-Z using a purpose-designed data extraction template. Extraction results were partially reviewed (6/29, 20%) by a second coder (JMS) to assess accuracy. To capture any missing data, the corresponding authors were e-mailed twice. Data extracted included the following: (1) study characteristics—authors, year of publication, country, study setting, study aims, study type, sample size, control group (where applicable), therapy approach applied, primary or secondary psychological outcomes, and symptom assessment measures and participant characteristics such as age, sex, diagnosed psychological disorders, severity of symptoms, and individual study outcomes; (2) intervention characteristics—BT intervention design based on the structure, content, and ratio of BT sessions; number, periodicity, and duration (in minutes) of face-to-face and digital sessions; treatment length (in weeks); and (3) BT intervention outcomes—treatment efficacy, uptake, adherence, cost-effectiveness, acceptability, therapeutic alliance, and barriers and facilitators to BT reported.

Data Analysis

To address the objectives of this review, quantitative variables regarding the BT intervention structure were summarized and described. We used descriptive statistics (mean, percentages, and range) to describe quantitative data regarding study and participant characteristics; BT intervention uptake, adherence, and completion rates; treatment length (in weeks); number, time (in minutes), ratio, and periodicity of face-to-face and digital sessions; treatment acceptability; efficacy; and therapeutic alliance. Barriers to and facilitators of BT were qualitatively analyzed using a thematic analysis [30] approach. Qualitative data on BT structure and content were analyzed using a content analysis approach [31]. Categories and subcategories were summarized in a framework that builds on the concepts described by Erbe et al [24] (Textbox 1).

Textbox 1. Classification—blended model designs.

Interaction between face-to-face and digital components: integrated vs sequential

  • Integrated models present both the digital and face-to-face components as collaborating parts within a therapy regimen, with both components delivered within the course of the intervention [24].
  • Sequential models present the digital component delivered in entirety before or after face-to-face component delivery [24]. Sequential interventions start by delivering a “batch” of either face-to-face or digital sessions. Once the first “batch” is finished, the other component gets delivered.
    • Stepped care is considered a special type of sequential design in which the digital component is a step in the intervention sequence [24]. Stepped care interventions deliver the least intensive or costly treatment first and then progress to more intensive or aftercare treatment, if required. Hence, the “blend” in stepped care only effectuates after the first stage (digital) of treatment is complete and if patients require additional (face-to-face) care.

Role of the components in the intervention: core vs supplementary

  • Core components are an indispensable part of the blended intervention, as they deliver new therapeutic elements (ie, modules complement each other).
  • Supplementary components present content that has already been discussed during the intervention, that is, content of one component is supplementary to the content delivered in the main component. For example, face-to-face content may be supplemented by reinforcing exercises and homework on the web.

Delivery pattern of face-to-face or digital components: alternate vs case by case

  • Alternate delivery is a configuration in which each session is delivered by alternating face-to-face or digital components in a fixed ratio. The distribution of components is preset for the entire intervention; this may feature as a 1:1 ratio, but other ratios (eg, 2 digital to1 face-to-face) of distribution are possible.
    • Linear delivery is specific to sequential designs in which all digital sessions are delivered in a row followed by all face-to-face sessions in a row, or vice versa.
  • Case-by-case delivery is a configuration in which therapists assess and formulate a strategy for distributing the face-to-face or digital sessions adapted to the clients’ or patients’ needs on a case-by-case basis.

Digital content assignment: personalized vs standardized

  • Personalized content assignment is not preset; therapists and patients decide which materials to complete, tailoring them to patients’ needs.
  • Standardized content assignment is largely preset; materials are delivered to all patients undergoing treatment with little or no changes to content.
Meta-Analyses

Although a meta-analysis was not originally included in the registered protocol, data collection and analysis processes indicated the relevance of meta-analyzing treatment outcomes for enhancing systematic review results. The meta-analysis was conducted using the Comprehensive Meta-Analysis program [32] to investigate treatment efficacy between the treatment and control dyads. A meta-analysis of BT interventions only was also conducted to investigate associations between BT structure and content and treatment outcomes. Pre-post outcome means and SD, alongside data on sample size at post–time points were included in the analysis. Standardized difference in means (Cohen d) and 95% CIs were used as effect size (ES) measures, and z values were used to test the null hypothesis (ES=0). We used a random effects meta-analysis due to expected heterogeneity. ES was set to negative numbers to show the change in symptoms (the lower the number, the higher the reduction in symptoms). Heterogeneity was assessed using Q test (Q), I-squared (I2), Tau-squared (T2), and Tau (T) scores. Publication bias was assessed using funnel plots and the trim and fill method by Duval and Tweedie [33].

Risk of Bias and Quality Assessment

Two independent reviewers (KFN-Z and JMS) assessed the risk of bias using the National Institutes of Health Study Quality Assessment Tool (quantitative) [34], the Critical Appraisal Skills Programme qualitative checklist [35], or the Mixed Methods Appraisal Tool [36].


Database Search Results

Database searches identified 2650 papers after removal of duplicates. Title and abstract screening resulted in 103 articles for full-text review. A total of 30 eligible articles were identified but only 29 were included in the review—one eligible paper was excluded as it reported the same data. The PRISMA diagram in Figure 1 [28] provides the details of the process.

Figure 1. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 flow diagram.

Quality Assessment

Quality assessment deemed most studies (n=22) to be of “good quality” as they addressed most of the quality assessment criteria applied. Seven articles [23,37-42] were classified to be of “fair” quality (Multimedia Appendix 3).

Study Characteristics

Of the 29 articles, 25 (86%) were prospective studies (randomized controlled trials [RCTs], n=14; feasibility or pilot, n=4; cohort or single arm, n=7); 3 (10%) were retrospective analyses of cohort studies; and 1 (3%) study used qualitative methods only. Most BT interventions (22/29, 76%) primarily treated depression, either exclusively (13/29, 45%) or in combination with anxiety treatment (9/29, 31%). Most studies (28/29, 96%) used a CBT approach, with 3 (10%) combining CBT and other approaches such as dialectical behavioral therapy and acceptance and commitment therapy (n=2) and motivational interviewing (n=1). Outcomes assessed were primarily symptom reduction (25/29, 86%), although 4 (14%) studies reported on the intervention process or working alliance outcomes as the primary focus (Table 1).

Collectively, the studies included a total of 12,322 (range 3-4448) patient participants, with 57.71% (n=7111) receiving BT interventions. Of the studies reporting on symptom reduction (28/29, 96%), all prescreened for clinical levels of psychological morbidity (Table 2).

Table 1. Characteristics of reviewed studies.
Study; countryStudy settingStudy aimsStudy designParticipants, N; BTa group, n; comparator, nTherapy type; clinical outcomes
Askjer and Mathiasen [43], 2021 and Mathiasen et al [44],b 2022; DenmarkSpecialized mental health careExplore if WAc predicted treatment outcomesExploratory; secondary analysis from an RCTd76; 38; 38; comparator: F2Fe CBTfCBT; WA, depressive symptoms
Berger et al [45], 2018; GermanyRoutine outpatient psychotherapy practicesInvestigate web-based treatment as adjunctive to depression treatment vs regular psychotherapyTwo-armed, pragmatic RCT98; 51; 47; comparator: TAUg: psychotherapyCBT; depressive symptoms
Bisson et al [46], 2022; United KingdomPrimary and secondary mental health settingsDetermine if CBT-TFh was noninferior to F2F CBT-TF for PTSDiPragmatic, multicenter, noninferiority RCT196; 97; 99; comparator: F2F CBT-TFCBT; severity of symptoms of PTSD
Cloitre et al [47], 2022; United StatesRoutine care in mental health outpatient clinicsAssess 2 ratios of F2F sessions to self-guided work on trauma-exposed veteransQuasi-experiment with a noninferiority design202; 202; NCjTransdiagnostic, trauma-informed CBT; PTSD and depression
Duffy et al [48], 2020; EnglandSpecialized mental health care serviceInvestigate iCBTk as a prequel for high-intensity depression and anxiety treatmentUncontrolled feasibility design (open study)123; 123; NCCBT; anxiety and depression and work and social functioning
Etzelmueller et al [49], 2018; GermanyRoutine care practice (clinics)Evaluate patient experience of a blended iCBT serviceQualitative, semistructured interviews15; 15; NCCBT; NDl depression
Høifødt et al [37], 2013; NorwayUniversity outpatient clinicEvaluate effectiveness and acceptability of a guided web-based program for depressionRCT106; 52; 54; comparator: delayed treatment, waitlist, or TAUCBT; depression symptoms
Jacmon et al [42], 2009; AustraliaPsychology private practiceAssess cost-effectiveness and convenience of partially digital depression treatmentSingle-arm, pretest-posttest study9; 9; NCCBT; depression levels
Kemmeren et al [50], 2019; France, Germany, Poland, and NetherlandsMultisetting (specialized mental health and routine primary care)Examine use of and engagement to blended CBT for depressionExploratory, secondary study from RCT231; 231; NCCBT; ND depression
Kenter et al [51], 2013; NetherlandsMental health care center; routine careReport on the uptake of digital treatment, on the profile of patients who prefer digital therapy, and on symptom reduction vs waitlistObservational study (electronic patient database)104; 55; 49; comparator: waitlistPSTm; ND depression, anxiety, and burnout
Kenter et al [52], 2015; NetherlandsMental health serviceCompare the effects and costs between blended and F2F treatmentsNaturalistic study: examined records of patients4448; 168; 4280; comparator: TAU: F2FCBT; ND depression and anxiety
Kok et al [38], 2014; NetherlandsOutpatient clinicsAssess clinical effectiveness of internet-based guided self-help vs waitlistRCT212; 105; 107; comparator: waitlistPsychotherapy; phobia and avoidance behavior
Kooistra et al [23], 2016; NetherlandsOutpatient specialized mental health care centerDevelop and evaluate a structured, blended CBT protocol for patients with depressionFocus-groups and single-arm, pre-post30; 9; NC (12 patients)CBT; ND depression
Kooistra et al [26], 2019; NetherlandsSpecialized mental health care (outpatient services)Compare costs and effectiveness of blended vs standard CBT for depressionPilot RCT with 2 parallel groups102; 53; 49; comparator: CBT-F2FCBT; self-reported depression severity
Kooistra et al [53], 2020; NetherlandsOutpatient specialized mental health clinicsInvestigate WA in bCBTn for depressionExploratory, secondary study from pilot RCT92; 47; 45; comparator: regular CBTCBT; ND depression levels
Lungu et al [54], 2020; United StatesEmployer programEvaluate the effectiveness of a video-based CBT and internet interventionRetrospective cohort study385; 385; NCCBT+UTPo, ACTp, and DBTq; ND depression and anxiety
Ly et al [55], 2015; SwedenClinical settingEvaluate a blended treatment for depressionNoninferiority RCT93; 46; 47; comparator: F2F BArBA; depression
Månsson et al [39], 2013; SwedenClinical settingExplore clinical outcomes and user experiences of internet-delivered therapy. To develop or test a bCBT modelMixed methods, case series, pilot study (pre-post re BT testing)23; 15; NC (patients, n=15; therapists, n=8)CBT; ND anxiety and depression
Månsson et al [40], 2017; SwedenOutpatient psychiatric clinicEvaluate an internet-based support as adjunct to F2F CBTFeasibility study54; 45; NC (patients, n=45; therapists, n=9)CBT; ND anxiety and depression symptoms
Mol et al [56], 2018; NetherlandsOutpatient clinicExplore therapist behaviors; adherence; and patient outcome in digital therapyObservational study64; 45; NC (patients, n=45; therapists, n=19)CBT; ND depression levels
Nakao et al [57], 2018; JapanOutpatient medical institutionsEvaluate effectiveness of web-based bCBT in reducing therapist time in patients with depressionSingle-blinded RCT40; 20; 20; comparator: waitlist + pharmacological treatmentCBT; depression symptoms
Romijn et al [41], 2021 and Romijn et al [58];b NetherlandsOutpatient specialized mental health care centersExplore therapist fidelity to bCBT protocols for anxiety disordersMixed methods (derived from a larger RCT)114; 52; 62; comparator: CBT F2FCBT; anxiety symptoms
Tarp et al [59], 2022; DenmarkPublic municipal outpatient alcohol clinicsDescribe development and testing of a digital program; participant experiences; and usability of BTFeasibility and pilot study32; 22; NC (development: 7 therapists+3 patients)CBT + motivational interviewing; —s (intervention system usability)
Thase et al [60], 2018; United StatesDepartment of psychiatry of medical schoolsEvaluate the efficacy of computer and therapist-assisted CBT vs standard CBTNoninferiority RCT154; 77; 77; comparator: CBT F2FCBT; depression symptom severity
van de Wal et al [61], 2017; NetherlandsCancer hospitals: academic, regional, and outpatientInvestigate the efficacy of BT for FCRt in cancer survivorsRCT: 2-arm, parallel group, longitudinal88; 45; 43; comparator: TAU (any)CBT; FCR severity
Vernmark et al [62], 2019; SwedenMental health care centersExplore patient- and therapist-rated WA in bCBT and WA as a predictor for changeExploratory secondary study from RCTs151; 75; NCCBT; depression levels
Witlox et al [63], 2021; NetherlandsMental health service at general practicesExamine the effectiveness of blended ACT for older adults with anxietyRCT (single-blinded)314; 150; 164; comparator: TAU (FTF CBT)ACT; anxiety severity
Wu et al [64], 2021; United StatesEmployer mental health program clinical servicesEvaluate the outcomes of a blended care coaching program for anxiety and depressionRetrospective cohort analysis1496; 1496; NCCBT-based + CBT, DBT, and ACT; anxiety and depression symptoms
Wu et al [65], 2021; United StatesEmployer mental health program clinical servicesExamine the effectiveness and the impact of bCBT on anxiety and depressionRetrospective cohort analysis3401; 3401; NCCBT+DBT and ACT; anxiety and depression symptoms

aBT: blended therapy.

bLinked study.

cWA: working alliance.

dRCT: randomized controlled trial.

eF2F: face to face.

fCBT: cognitive behavioral therapy.

gTAU: treatment as usual.

hiCBT-TF: internet-guided cognitive behavioral therapy with trauma focus.

iPTSD: posttraumatic stress disorder.

jNC: no comparator.

kiCBT: internet-delivered cognitive behavioral therapy.

lND: not disclosed.

mPST: problem-solving therapy.

nbCBT: blended cognitive behavioral therapy.

oUTP: unified transdiagnostic protocol.

pACT: acceptance and commitment therapy.

qDBT: dialectical behavioral therapy.

rBA: behavioral activation.

sNot applicable.

tFCR: fear of cancer recurrence.

Primary outcomes of individual studies included efficacy or effectiveness (14/29, 48%) [37-39,45,46,48,54,55,57, 60,61,63-65]; working alliance (3/29, 10%) [43,53,62]; usability and uptake (3/29, 10%) [50,51,59]; feasibility (2/29, 7%) [23,42]; and patient or therapist (4/29, 14%) [40,41,49,56] experience. One (4%) study [47] explored multiple primary outcomes of therapeutic alliance, compliance, and symptom reduction, and 2 (7%) studies [26,52] reported dual outcomes of efficacy and cost.

Table 2. Patient participants’ characteristics.
StudyAge (y), mean (SD); rangeFemale, n (%)Pre-post time points, assessment tool, psychological symptoms per group: mean (SD) and severity at baseline
Askjer and Mathiasen [43], 202135 (13.96); 18-7156 (74)
  • Baseline and 12 wk
  • PHQ-9a, Depression
    • BTb: 14.4 (4.1), moderate to severe
    • Comparator: 16.05 (3.8), moderate to severe
Berger et al [45], 201843 (12.0); 19-7365 (66)
  • Baseline and 12 wk
  • BDI-IIc, Depression
    • BT: 29.6 (8.4), severe
    • Comparator: 30.2 (11.2), severe
  • GAD-7d, Anxiety
    • BT: 11.7 (4.9), moderate
    • Comparator: 12 (4.6), moderate
Bisson et al [46], 202236 (13.4); 18 to >65125 (64)
  • Baseline and 16 wk
  • CAPS-5e, PTSDf
    • BT: 34.6 (6.8), mild to moderate
    • Comparator: 35.6 (6.7), mild-moderate
  • PHQ-9, Depression
    • BT: 15.1 (6.7), moderate to severe
    • Comparator: 13.4 (4.6), moderate
  • GAD-7, Anxiety
    • BT: 13.9 (4.9), moderate
    • Comparator: 13.4 (4.6), moderate
Cloitre et al [47], 202244 (11.73); 22-77122 (60)
  • Baseline; 10 wk
  • PCL-5g, PTSD
    • BT: 50.7 (15.5), severe
  • PHQ-9, Depression
    • BT: 15.6 (5.4), moderate to severe
    • Comparator:—h
Duffy et al [48], 202041 (13.1); 17-8085 (69)
  • Baseline; at iCBTi end
  • PHQ-9, Depression
    • BT: 15.6 (5.5), moderate to severe
  • GAD-7, Anxiety
    • BT: 14.8 (4.5), moderate to severe
    • Comparator: —
Etzelmueller et al [49], 201855 (—); 24-6418 (72)
  • Weekly assessments, —
  • QIDS-16-SRj, Depression
    • BT: 14.8 (4.4), moderate
    • Comparator: —
Høifødt et al [37], 201336 (11.3); 19-6377 (73)
  • Baseline and 7 wk
  • BDI-II, Depression
    • BT: 21.1 (6.85), moderate
    • Comparator: 22.3 (6.7), moderate
  • BAIk, Anxiety
    • BT: 12.05 (11.1), mild
    • Comparator: 15.3 (10.9), mild
Jacmon et al [42], 200935 (10.37); —4 (44)
  • Baseline; 6 wk
  • BDI-II, Depression
    • BT: 26.5 (1.5), moderate
    • Comparator: —
Kemmeren et al [50], 201942 (12.9); 18-74129 (64)
  • Baseline; —
  • PHQ-9, Depression
    • BT: 16.2 (4.7), moderate to severe
    • Comparator: —
Kenter et al [51], 201337 (10.8); 18-6173 (70)
  • Baseline; 5 wk
  • BDI-II, Depression
    • BT: 23.5 (7), moderate
    • Comparator: 22.4 (8.7)
  • HADSl, Anxiety
    • BT: 10.6 (2.9), moderate
    • Comparator: 11.1 (2.4)
  • MBIm, Burnout
    • MBI-EE, BT: 2.5 (1.7); Comparator: 2.6 (1.4)
    • MBI-D, BT: 2.0 (1.5); Comparator: 2.0 (1.5)
    • MBI-C, BT: 3.5 (1.3); Comparator: 3.6 (1.3)
Kenter et al [52], 201547 (18.7); 18-912442 (55)
  • First and last F2F sessions
  • GAFn, Depression group
    • BT: 54.6 (4.9), moderate
    • Comparator: 54.7 (4.7), moderate
  • GAF, Anxiety group
    • BT: 59 (5.3), moderate
    • Comparator: 59.1 (5.2), moderate
Kok et al [38], 201435 (11.7); —130 (61)
  • Baseline; 5 wk
  • FQo, Phobia
    • BT: 42.4 (23.4)
    • Comparator: 38.2 (21.9)
  • CES-Dp, Depression
    • BT: 25 (8.6), severe
    • Comparator: 24.7 (8.4), severe
  • BAI, Anxiety
    • BT: 45 (13.8), severe
    • Comparator: 44.48 (13.1), severe
Kooistra et al [23], 201638 (8.36); 27-505 (55)
  • Baseline; 10 wk
  • IDS-SR30q, Depression:
    • BT: 40.4 (12.9), moderate
  • BAI, Anxiety
    • BT: 22 (12.4), moderate
    • Comparator: —
Kooistra et al [26], 201939 (10.9); —64 (63)
  • Baseline; 10 wk
  • IDS-SR30, Depression:
    • BT: 45.2 (12.1), moderate
    • Comparator: 41.5 (11.6), moderate
Kooistra et al [53], 202038 (11.0); —43 (60)
  • Baseline; 10 wk
  • QIDS-SR, Depression
    • BT: 16.6 (4.9), severe
    • Comparator: 15.9 (4.1), severe
Lungu et al [54], 202033 (8.0); —244 (64)
  • Baseline and 6 wk
  • PHQ-9, Depression
    • BT: 10.8 (4.7), moderate
  • GAD-7, Anxiety
    • BT: 11.7 (3.9), moderate
    • Comparator: —
Ly et al [55], 201531 (11.4); 18-7365 (70)
  • Baseline; 9 wk
  • BDI-II, Depression
    • BT: 29 (8.1), severe;
    • Comparator: 27.3 (7.9), severe
  • PHQ-9, Depression
    • BT: 15.4 (4.7), moderate to severe;
    • Comparator: 15.3 (4.5), moderate to severe
  • BAI, Anxiety
    • BT: 15.7 (12.1), mild to moderate;
    • Comparator: 17.5 (9.2), moderate
Månsson et al [39], 201343 (15); 22-7010 (67)
  • Baseline; 9 wk
  • BAI, Anxiety
    • BT: 18.1 (7.7), moderate
  • GAD-7, Anxiety
    • BT: 11.9 (6), moderate
  • PHQ-9, Depression
    • BT: 12.1 (6), moderate
  • MADRS-Sr, Depression
    • BT: 21.2 (4), moderate
    • Comparator: —
Månsson et al [40], 201730 (10.6); 18-6036 (80)
  • Baseline; 12 wk
  • PHQ-9, Depression
    • BT: 13.3 (5.2)
  • MADRS-S, Depression
    • BT: 21 (8.7), moderate
  • BAI, Anxiety
    • BT: 20.5 (9.8)
  • GAD-7, Anxiety
    • BT: 10.3 (6), moderate
    • Comparator: —
Mol et al [56], 201836 (12.3); 21-6433 (73)
  • Baseline; approximately 26 wk
  • QIDS, Depression
    • BT: 15.8 (3.8), moderate to severe
    • Comparator: —
Nakao et al [57], 201840 (9.7); —20 (50)
  • Baseline; 12 wk
  • GRID-HAMDs, Depression
    • BT: 18.3 (3.7), moderate to severe;
    • Comparator: 18.5 (3.6), moderate to severe
  • BDI-II, Depression
    • BT: 28 (8.8), moderate;
    • Comparator: 24.4 (7.8), moderate
  • QIDS, Depression
    • BT: 14.8 (4.2), moderate;
    • Comparator: 13.5 (4), moderate
Romijn et al [41], 202137 (11.0); 19-6223 (52)
  • Baseline; 15 wk
  • BDI-II, Depression
    • BT: 24 (12.2), moderate;
    • Comparator: 24 (10.3), moderate
  • BAI, Anxiety
    • BT: 27.9 (12), severe;
    • Comparator: 27.15 (11.7), severe
Tarp et al [59], 202247 (12); 28-737 (32)
  • Addictive disorder: —
Thase et al [60], 201846 (14.3); —102 (66)
  • Baseline and week 16
  • Depression: HDRSt
    • BT: 19.8 (3.5), moderate to severe
    • Comparator: 19.6 (3.8), moderate to severe
van de Wal et al [61], 201759 (11.3); 31-7747 (53)
  • Baseline and 12 wk
  • CWSu, FCR
    • BT: 19.6 (3.7), high;
    • Comparator: 19.6 (3.7), high
  • HADS-D, Depression
    • BT: 5.9 (4.2), low;
    • Comparator: 6.8 (4.7), low
  • HADS-A, Anxiety
    • BT: 8.1 (4.1), mild;
    • Comparator: 8.4 (4.9), mild
Vernmark et al [62], 201935 (13.9); —54 (74)
  • Baseline; 10 wk
  • PHQ-9, Depression
    • BT: 14.3 (5.1), moderate
    • Comparator: —
Witlox et al [63], 202163 (5.70); 55-75192 (61)
  • Baseline; 12 wk
  • PHQ-9, Depression
    • BT: 7 (4), mild;
    • Comparator: 7.9 (3.5)
  • GAD-7, Anxiety
    • BT: 8.2 (4), mild to moderate;
    • Comparator: 8.8 (3)
Wu et al [64], 202133 (8.62); —921 (62)
  • Wk 0-7 and wk 8-15
  • PHQ-9, Depression
    • BT: 6 (3), mild
  • GAD-7, Anxiety
    • BT: 9.6 (2), mild to moderate
    • Comparator: —
Wu et al [65], 202133 (8.68); —2218 (65)
  • Wk 0-7 and wk 8-15
  • PHQ-9, Depression
    • BT: 10.7 (4.9), moderate
  • GAD-7, Anxiety
    • BT: 11.8 (4.1), moderate
    • Comparator: —

aPHQ-9: Patient Health Questionnaire-9.

bBT: blended therapy.

cBDI-II: Beck Depression Inventory II.

dGAD-7: Generalized Anxiety Disorder-7.

eCAPS-5: Clinician-Administered Posttraumatic Stress Disorder Scale for the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition.

fPTSD: posttraumatic stress disorder.

gPCL-5: Posttraumatic Stress Disorder Checklist for the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition.

hNot available.

iiCBT: internet-delivered cognitive behavioral therapy.

jQIDS-16-SR: 16-Item Quick Inventory of Depressive Symptomatology, self-reported.

kBAI: Beck Anxiety Inventory.

lHADS: Hospital Anxiety and Depression Scale.

mMBI: Maslach Burnout Inventory.

nGAF: Global Assessment of Functioning.

oFQ: Fear Questionnaire.

pCES-D: Centre for Epidemiologic Studies Depression Scale.

qIDS-SR30: Inventory of Depressive Symptomatology Self-Rated.

rMADRS-S: Montgomery Åsberg Depression Rating Scale—self-rating version.

sGRID-HAMD: 17-item GRID-Hamilton Depression Rating Scale score.

tHDRS: Hamilton Depression Rating Scale.

uCWS: Cancer Worry Scale.

Classification of BT Models

On the basis of the models defined by Erbe et al [24], the majority (26/29, 90%) of the studies reported an integrated intervention design, where new therapeutic content was delivered either (1) across both the face-to-face and digital modalities (core; n=14) or (2) primarily using one modality (usually the face-to-face component) with additional content delivered as supplementary material (n=12). Integrated interventions were the most common designs for addressing depression (n=14) and depression and or anxiety (n=8). Three studies were classified as sequential designs and described a core role for both face-to-face and digital components. One sequential model was delivered as stepped care in which most patients received digital therapy only.

BT delivery was further differentiated based on whether both components were delivered in a preset, alternate format or a tailored, case-by-case arrangement. Most integrated interventions (17/26, 65%) used an alternate delivery format. Therapeutic content within integrated and alternate designs had either core (9/17, 53%) or supplementary (8/17, 47%) roles.

In 19 (65%) studies, patients engaged with digital content following a standardized program with minimal tailoring of the materials presented. In contrast, 10 (35%) studies described a more personalized manner of assigning or interacting with digital content where the therapist and patient have more autonomy to choose, change, or create digital content according to individual need. An overview of model classifications is presented in Table 3.

Table 3. Blended therapy model classification per study.
StudyInteraction of F2Fa and digital componentsRole of F2F and digital componentsPattern of delivery of F2F and digitalDigital content delivery

IntegratedSequentialCoreSupplementaryAlternateCase by casePersonalizedStandardized
Askjer and Mathiasen [43], 2021



Berger et al [45], 2018



Bisson et al [46], 2022



Cloitre et al [47], 2022



Duffy et al [48], 2020b




Etzelmueller et al [49], 2018



Høifødt et al [37], 2013



Jacmon et al [42], 2009



Kemmeren et al [50], 2019



Kenter et al [51], 2013b




Kenter et al [52], 2015



Kok et al [38], 2014b




Kooistra et al [23], 2016



Kooistra et al [26], 2019



Kooistra et al [53], 2020



Lungu et al [54], 2020



Ly et al [55], 2015



Månsson et al [39], 2013



Månsson et al [40], 2017



Mol et al [56], 2018



Nakao et al [57], 2018



Romijn G et al [41], 2021



Tarp et al [59], 2022



Thase et al [60], 2018



van de Wal et al [61], 2017



Vernmark et al [62], 2019



Witlox et al [63], 2021



Wu et al [64], 2021



Wu et al [65], 2021



aF2F: face to face.

bSequential models present a linear pattern of delivery.

Structure, Content, and Ratio of Sessions in BT Models

Overview

Within the integrated model, 81% (21/26) of studies reported commencing BT with the face-to-face component. Five integrated interventions began treatment with the digital component; of those, 4 [38,42,47,51] used the digital component as the intervention “anchor”—that is, the digital component led the therapeutic process. One [48] sequential intervention (stepped care) used the digital modality as a prequel for high-intensity face-to-face treatment based on patient symptom severity. Digital sessions were mostly delivered via website platforms with individualized access. Overall, digital session components presented CBT-based content and followed the frameworks used in face-to-face settings. Digital content was typically asynchronous. Intervention structure and content is summarized in Multimedia Appendix 4.

Face-to-Face Versus Digital Sessions Distribution in BT Models

In total, 26 (87%) studies reported the number of face-to-face sessions, which ranged from 3 to 21 sessions (mean 7, SD 4.2). Of those reporting the number of face-to-face sessions, 24 (92%) used an integrated intervention design. Mean face-to-face session duration across studies was 49 minutes (SD 11.7, range 27-65 min/session). Periodicity of sessions were reported by 24 studies, with most of those studies describing face-to-face sessions as delivered weekly (12/24, 50%) [23,26,37,39,41,42,45,49,53,57,59,64].

A total of 20 (69%) studies reported on the number of digital sessions (mean 8, SD 3, range 4-14 sessions)—of those studies, 18 (90%) presented an integrated design. Although the mean time for digital sessions was largely undefined and unreported, 12 (41%) studies [37,40,45,47,50,52,57,60-63,65] reported that digital modules were typically developed to range between 15 and 60 minutes. Eight (28%) studies [42,45,46,48,57,59,60,64] allowed patients to complete modules at their own pace; 13 (45%) studies [39,40,42,45,48,49,54-56,60,61,64,65] reported digital sessions’ periodicity to be flexible; weekly (14/29, 48%) [23,26,37,38,41,46,47,51-53,57,59,62,63] or fortnightly (2/29, 7%) [43,50] completion was also reported.

Face-to-Face and Digital Ratio

In total, 16 (55%) studies [23,26,37,41,42,45-50,53,56,60,62,65] reported the ratio of face-to-face and digital sessions. Most of those studies had an integrated design (14/16, 88%) and typically delivered sessions at a 1:1 ratio (1 face-to-face to 1 digital).

Treatment Length

The BT mean length of treatment was 12 (SD 5.1, range 6-26) weeks; however, this was unreported for 5 studies [38,49,51,52,63] (Table 4).

Table 4. Model classification versus session structure.

Integrated (n=26)Sequential (n=3)Core (n=17)Supplementary (n=12)Alternate (n=17)Case by case (n=9)Lineara (n=3)Personalized (n=10)Standardized (n=19)
Treatment lengthb, mean (range); n12 (6-21); 2321; (—c); 113 (6-26); 1311 (6-21); 1113 (6-26); 1610 (6-12); 721; (—); 110 (6-21); 914 (8-26); 15
Face-to-face sessions

Number, mean (range); n8 (3.5-21); 233.5 (0-10); 36 (0-12); 159 (4-21); 117 (3.5-12); 179 (4-21); 610; (—); 19 (4-21); 96 (0-12); 17

Time (min), mean (range); n49 (27-65); 17NRd; 047 (27-65); 951 (45-65); 846.5 (27-65); 1255 (45-60); 5NR; 053 (44-60); 647 (27-65); 11

Periodicity1we: n=12; 2wf: n=4; 3wg: n=1; varh: n=7NR; (0)1w: n=6; 2w: n=3; 3w: n=1; var: n=31w: n=6; var: n=4; 2w: n=11w: n=6; 2w: n=4; 3w: n=1; var: n=61w: n=6; var: n=1NR1w: n=5; var: n=31w: n=7; 2w: n=4; 3w: n=1; var: n=4
Digital sessions

Number, mean (range); n9 (4-14); 174 (4-5); 27 (4-14); 119 (7-14); 87 (4-10); 1110 (6-14); 64; 18 (4-14); 58 (4-14); 15

Time (min), mean (range); n38 (6-65); 8NR; 044 (30-65); 432 (6-62); 438 (28-65); 538 (6-62); 3NR; 036 (6-62); 440 (28-65); 4

Periodicity1w: n=13; 2w: n=1; var: n=122w: n=1; anyi: n=21w n=9; 2w: n=2; any: n=62w: n=4; any: n=81w: n=9; 2w: n=2; any: n=61w: n=2; any: n=71w: n=2; any: n=11w: n=1; any: n=91w: n=12; 2w; n=2; any: n=5

aLinear describes the delivery pattern typical of sequential designs.

bTreatment length is measured in weeks.

cNot applicable.

dNR: not reported.

e1w: weekly.

f2w: 2-weekly.

g3w: 3-weekly.

hvar: variable (eg, varied from weekly to fortnightly or other pattern).

iany: anytime (ie, no pattern from the outset).

Outcomes of BT Interventions

Treatment Uptake

In total, 25 (86%) studies reported on BT uptake mean rates (mean 91%, SD 10.2%, range 60%-100%). Of those, 24 (96%) studies [23,26,37-43,45-48,50,51,53,55-57,59-63] reported a mean uptake of 92% (SD 8.2%, range 73%-100%) and 1 (4%) study [49] reported a lower uptake (60%). A total of 14 (48%) studies reported on treatment completion rates, with an average of 61% (SD 29.4%, range 11.5%-100%) of patients completing treatment.

Treatment Adherence

Our review considered adherence as completing a minimum number of sessions determined by each study. However, adherence criteria differed across studies and there was a lack of data to confirm whether session structure or ratio influenced adherence to intervention. A total of 23 (279%) studies reported on BT adherence rates, with a mean of 81% (SD 11.8%). In total, 20 (69%) integrated studies reported on BT adherence (mean 83%, SD 11%, range 62%-100%). In contrast, all sequential studies (3/29, 10%) had a comparatively lower mean adherence (64%, SD 1.8). Dropout rates were reported in 25 (86%) studies, with 24 of those reporting <40% dropout rates (mean 18.5%, SD 17.2%, range 0%-38%). The intervention with the lowest adherence rate (16%) and highest dropout rate (84%) [38] had a sequential design.

Regarding the role of components within BT, interventions with supplementary designs presented higher adherence (mean 88%, SD 9%, range 72.5%-100%) than core designs (mean 76%, SD 11.7%, range 16%-100%). Details on the uptake and adherence reported per study are available in Multimedia Appendix 5.

Health Service Outcomes

Four (14%) studies reported on the impact of BT on therapist time: 2 studies [42,55] found a decrease, one study reported an increase [52], and one found no change [26] in the time needed to deliver therapy. Findings related to efficacy and costs were mixed, with one study [52] suggesting that BT was not cost-effective compared with face-to-face therapy, while another study [55] highlighted reduced costs due to the potential of BT for treating twice as many patients as compared with face-to-face treatment.

Patient Satisfaction and Working Alliance

Eight (28%) studies [23,37,38,43,45,46,49,63] reported on patient satisfaction with BT treatment—criteria for determining patient satisfaction were heterogeneous, but all studies reported it as “high.” Four (14%) studies [43,47,53,62] reported on working alliance and reported it as “high.” Two (7%) studies [43,62] suggested that the therapist-rated working alliance predicted treatment outcomes and that this may be specific to BT.

Barriers to and Facilitators of Intervention Uptake and Engagement

Potential barriers to intervention uptake reported [23,46,49,51,59] included a lack of understanding about the intervention and digital challenges. Reported [42,51,59] facilitators to intervention uptake included convenience and flexibility of the digital component, anonymity, and autonomy enabled by the BT design. Barriers to intervention engagement identified [37,38,42,45,46,48-50,56,61] included the good enough effect (ie, when patients drop out during the initial stages of the intervention arguing they “feel better” and “no longer need therapy” [66]), being left unchecked, reduced therapy support (ie, lack of therapist follow-up regarding digital activities), and digital challenges. Facilitators of intervention engagement included experience in the use of technology, a program tailored to patient-specific needs, patient-therapist digital communication between sessions, and a patient-therapist working alliance fostered throughout the intervention [37-39,43,45-50,52,57,64,65].

Treatment Efficacy

We conducted a meta-analysis to examine differences in treatment outcomes. There were only a sufficient number of studies to meta-analyze depression and anxiety outcomes.

Data pooled from 9 RCT studies demonstrated a moderate to large, significant improvement in depression symptoms (Cohen d=–1.1, 95% CI –0.6 to –1.6, P<.001). However, comparing treatment outcomes for anxiety interventions with controls (n=5), there was no significant improvement across studies (Cohen d=–0.1, 95% CI –0.3 to 0.05, P=.17). Between-study heterogeneity was high and did not change after conducting publication bias assessment using the funnel plot trim and fill method, both in the depression (Q=90.3; P<.001; I2=91.1; T2=0.1; T=0.7) and anxiety groups (Q=1.1; P=.17; I2=0; T2=0; T=0). We noted that estimates of heterogeneity are impacted by the very small number of studies analyzed (<10 studies).

Meta-analysis was also conducted to examine associations between depression and anxiety scores on various scales and BT structure. For depression, mixed-effect analysis suggested higher effects sizes for interventions where the therapeutic content was delivered primarily face to face with digital content supplementing the face-to-face content (n=11; Cohen d=–0.75, 95% CI –0.56 to –0.95) compared with digital therapeutic content delivered as core (n=10; Cohen d=–0.5, 95% CI –0.4 to –0.7)—however, differences were not statistically significant (P<.08). Similar associations were found for anxiety, with higher ESs for supplementary (n=8; Cohen d=–0.9, 95% CI –0.6 to –1.2) compared with core structure (n=5; Cohen d=–0.6, 95% CI –0.22 to –0.98). Mixed-effect analysis also indicated statistically significantly (P<.001) higher ESs for interventions with ≤6 face-to-face sessions both for depression (n=9; Cohen d=–0.7, 95% CI –0.5 to –0.9) and anxiety (n=7; Cohen d=–0.8, 95% CI –0.3 to –1.3) compared with interventions with >6 face-to-face sessions for depression (n=11; Cohen d=–0.6, 95% CI –0.4 to –0.8) and anxiety (n=5; Cohen d=–0.7, 95% CI –0.4 to –1). Similarly, interventions with >50% of sessions delivered digitally had higher ESs (P<.001) both for depression (n=5; Cohen d=–0.8, 95% CI –0.6 to –1.1) and anxiety (n=4; Cohen d=–0.8, 95% CI 0.006 to –1.6) compared with interventions where >50% sessions were delivered face to face, both for depression (n=9; Cohen d=–0.5, 95% CI –0.3 to –0.7) and anxiety (n=3; Cohen d=–0.58, 95% CI –0.3 to –0.9). Data regarding meta-analyses are available in Multimedia Appendix 6.


Overview

We reviewed blended psychological therapy models and classified them according to their structure, content, and ratio of face-to-face and digital sessions. Most BT interventions were CBT-based and addressed depression—for which models with integrated and supplementary designs resulted in improved treatment efficacy. Interventions typically used an integrated design with the face-to-face component “anchoring” the intervention. Essential, therapeutic content across treatment designs was typically delivered as both face to face and digital (ie, a core design) and in an alternate pattern. However, several studies used digital components to supplement therapeutic content delivered face to face. Most interventions also relied on standardized digital content rather than content tailored to individual patients.

Our study confirms that BT leads to improved overall patient uptake (mean 91%) and adherence (mean 81%), contrasting with the lower uptake and adherence rates previously reported for digital therapy alone. For example, an observational cohort study analyzed clinical data from 15,882 patients assessed for digital-only treatment of various psychological disorders, reporting 22% uptake and 68% adherence rates [14]. In addition, review studies on digital therapy for depression and anxiety symptoms [16] and for depression alone [17] indicated mean uptake rates of 56% (range 21%-88%) and 88% (range 42%-100%), respectively, as well as mean adherence rates of 18% (range 7%-42%) and 60% (range 14%-93%), respectively. These contrasting findings suggest a potential connection between improved engagement with digital components when these are integrated into an intervention with a more prominent role of the therapist, that is, in a blended format.

Meta-Analysis Results: Treatment Versus Control Dyads

Across CBT-based RCTs, symptom reduction was observed for both depression and anxiety—although the reduction in anxiety symptoms was not substantial. Our result contrasts with overall findings on effectiveness of digital-only interventions exclusively addressing anxiety [67], which indicate effective outcomes. However, a subgroup analysis in that study confirmed similar ESs of both digital and face-to-face anxiety treatments. The lack of significance of our results might reflect the fact that only 1 included study addressed anxiety as a primary intervention outcome, while the other 4 interventions primarily targeted posttraumatic stress disorder, Fear of Cancer Recurrence, or depression. This suggests that transdiagnostic interventions may not be sufficient for treating anxiety—even with therapist guidance.

Meta-Analysis Results: BT Treatment Outcomes Versus the BT Model

Our analysis indicated that interventions that delivered face-to-face sessions for depression and anxiety in a lower ratio (≤50%) and in a lower number (≤6) had higher, statistically significant overall ESs. As the ratio of face-to-face sessions was similar in core or supplementary models, it is unclear what role digital sessions played in the delivery of therapeutic content compared with simply supplementing face-to-face sessions. Moreover, ESs for depression and anxiety in supplementary designs (Cohen d=–0.75 and Cohen d=–0.87, respectively) were higher than those in core designs (Cohen d=–0.53 and Cohen d=–0.6, respectively). Those findings suggest that therapeutic content may achieve better results when introduced by therapists and reinforced digitally—a characteristic of supplementary models, in which the digital component extends or reinforces face-to-face content. In addition, supplementary models might provide a more seamless transition between face-to-face and digital content as therapists can identify and discuss challenging topics with patients before they go on the web, what could result in enhanced patient engagement, adherence and treatment results. This argument is supported by studies on participants’ preference for BT models that enable greater therapist-patient interaction [21,50,68,69]. In addition, participants’ views reported across our study also suggest that improved digital access and support from therapist facilitated BT engagement.

The higher ESs of supplementary versus core designs may also reflect the therapists’ preference for face-to-face contact. This argument finds support in studies on health professionals’ preferences regarding face-to-face versus digital delivery, both in blended [68,70] and digital-only [20,71] interventions. Those studies suggest that, despite recognizing the advantages of digital interventions, professionals perceive face-to-face delivery as more attractive than digital delivery, which could influence the endorsement of digital therapy delivery as a supplement. This suggests that therapists might feel more comfortable engaging with and promoting the digital arm in a supplementary way.

In addition, it is possible that both therapists and patients expect the “bulk” of the therapeutic content to be delivered face to face in blended interventions, explaining why we found BT core models to be less efficacious than supplementary. Therapy expectations would also help explain the contrast of our results with research [67,72] on using digital therapy alone for depression and anxiety, which found digital interventions to be as good as or better than face-to-face interventions. Perhaps because patients engaging in digital-only treatment would expect therapeutic content to be delivered digitally, as there is no face-to-face option, they fare better on the digital component than they would in a BT model.

Optimizing Effectiveness, Time, and Resources in BT Treatment

One aim of BT interventions [24] is to enable better balance between treatment effects; patient engagement; treatment time; and the use of resources for both patients and therapists. BT models with integrated, core, alternate, and standardized designs allow for optimized treatment delivery. However, the results of our meta-analysis suggest that supplementary BT models are more effective. Considering these arguments, perhaps a midway alternative would be to promote a more digitally focused role of the therapist in a blended design. Following this idea, therapists would support and encourage patients to complete digital content as an enhancing adjunct to face-to-face contact—and not only as an “add-on” feature. A more digitally focused role of the therapist might promote increased patient engagement, enabling improved outcomes with lower doses of face-to-face treatment.

Study Limitations

We optimized database search terms with the assistance of a librarian; however, it is possible that eligible studies were not included in this review. In addition, the analysis did not assess the potential impact of heterogeneities found among selected studies on the variables analyzed, for example, whether different populations, settings, or therapeutic approach applied in the interventions might affect uptake or adherence or even the way blended sessions are delivered. Furthermore, the small number of studies included in our meta-analysis impacted the breadth of our results. In addition, there were limited studies describing intervention structure and content of both face-to-face and digital components in detail. Despite having contacted authors regarding missing data, several gaps remained on key variables investigated (eg, number and time of face-to-face and digital sessions, adherence parameters, and acceptability of intervention), which impacted the depth of analysis. Hence, the outcomes reported in this study should be interpreted with caution.

Recommendations

Despite growing evidence regarding BT efficacy, the lack of clearer, detailed data reporting on its structure and content poses challenges to scientific reproducibility of BT, possibly affecting its implementation success. Details related to the number, time, and distribution of sessions; specific content of both digital and face-to-face sessions, as well as the role, relevance, and influence of the digital component within the therapy plan; feedback on face-to-face and digital session content; and the use of assigned digital materials as well as the perception of its usefulness from the perspective of both therapists and patients are examples of useful data that are not adequately reported. We recommend that future studies include a more detailed reporting of methodology, particularly regarding the structure and content of sessions.

Conclusions

This systematic review examined blended models for the treatment of psychological disorders to identify what aspects of BT underpin effective treatment and improved engagement. Evidence suggests that implementing an integrated model is feasible in the treatment of psychological disorders. BT was reported as being either more effective or noninferior to face-to-face treatment, particularly when applied to the treatment of anxiety and depression. BT interventions studied reported high mean uptake and adherence rates, showing promise in improving engagement to treatment. Higher ESs were found for depression and anxiety outcomes in interventions with integrated, supplementary models; with a lower number of face-to-face sessions; and with a lower ratio of face-to-face versus digital sessions, suggesting that combining a more digitally focused therapist role with fewer face-to-face sessions can be effective and increase access to treatment.

To support improved reporting, we have developed a taxonomy for BT models based on the key themes identified in this review regarding model structure and components. Future studies detailing the structure and content of BT models may help identify suitable models for the treatment of different psychological disorders.

Acknowledgments

The Psycho-oncology Co-operative Research Group supported the development of this research. The Psycho-oncology Co-operative Research Group is funded by Cancer Australia through their Support for Clinical Trials Funding Scheme.

Authors' Contributions

KFN-Z, HLS, PB, LB, and JMS were responsible for conceptualization and protocol development. The literature search was conducted by KFN-Z and JMS, and study selection was carried out by KFN-Z, JMS, and PB. Data analysis was performed by KFN-Z and JMS. The initial draft was prepared by KFN-Z and JMS, and all authors (KFN-Z, HS, PB, LB, and JMS) participated in reviewing and editing the draft.

Conflicts of Interest

None declared.

Multimedia Appendix 1

PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist.

PDF File (Adobe PDF File), 158 KB

Multimedia Appendix 2

Database searches: examples.

PDF File (Adobe PDF File), 382 KB

Multimedia Appendix 3

Quality assessment.

PDF File (Adobe PDF File), 198 KB

Multimedia Appendix 4

Blended therapy structure: content described.

PDF File (Adobe PDF File), 330 KB

Multimedia Appendix 5

Uptake: adherence described.

PDF File (Adobe PDF File), 176 KB

Multimedia Appendix 6

Meta-analyses data: graphs.

PDF File (Adobe PDF File), 619 KB

  1. Comprehensive mental health action plan 2013-2030. World Health Organization (WHO). 2021. URL: https://www.who.int/publications/i/item/9789240031029 [accessed 2024-04-29]
  2. World health statistics 2022: monitoring health for the SDGs, sustainable development goals. World Health Organization (WHO). 2022. URL: https://www.who.int/publications/i/item/9789240051157 [accessed 2024-04-29]
  3. The WHO special initiative for mental health (2019-2023): universal health coverage for mental health. World Health Organization (WHO). 2019. URL: https://iris.who.int/handle/10665/310981 [accessed 2024-04-29]
  4. Guzman D, Ann-Yi S, Bruera E, Wu J, Williams JL, Najera J, et al. Enhancing palliative care patient access to psychological counseling through outreach telehealth services. Psychooncology. Jan 10, 2020;29(1):132-138. [CrossRef] [Medline]
  5. Sinclair C, Holloway K, Riley G, Auret K. Online mental health resources in rural Australia: clinician perceptions of acceptability. J Med Internet Res. Sep 2013;15(9):e193. [FREE Full text] [CrossRef] [Medline]
  6. Hadjistavropoulos HD, Schneider LH, Hadjistavropoulos T, Titov N, Dear BF. Effectiveness, acceptability and feasibility of an internet-delivered cognitive behavioral pain management program in a routine online therapy clinic in Canada. Can J Pain. Mar 21, 2018;2(1):62-73. [FREE Full text] [CrossRef] [Medline]
  7. Hedman E, Ljótsson B, Lindefors N. Cognitive behavior therapy via the internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Rev Pharmacoecon Outcomes Res. Dec 2012;12(6):745-764. [CrossRef] [Medline]
  8. Christensen H, Batterham P, Calear A. Online interventions for anxiety disorders. Curr Opin Psychiatry. Jan 2014;27(1):7-13. [CrossRef] [Medline]
  9. Hollinghurst S, Peters TJ, Kaur S, Wiles N, Lewis G, Kessler D. Cost-effectiveness of therapist-delivered online cognitive-behavioural therapy for depression: randomised controlled trial. Br J Psychiatry. Oct 02, 2010;197(4):297-304. [CrossRef] [Medline]
  10. Saddichha S, Al-Desouki M, Lamia A, Linden IA, Krausz M. Online interventions for depression and anxiety - a systematic review. Health Psychol Behav Med. Jan 01, 2014;2(1):841-881. [FREE Full text] [CrossRef] [Medline]
  11. Andersson G, Topooco N, Havik O, Nordgreen T. Internet-supported versus face-to-face cognitive behavior therapy for depression. Expert Rev Neurother. Dec 15, 2016;16(1):55-60. [CrossRef] [Medline]
  12. Emmelkamp PM. Effectiveness of cybertherapy in mental health: a critical appraisal. Stud Health Technol Inform. 2011;167:3-8. [Medline]
  13. Bisby MA, Karin E, Hathway T, Scott AJ, Heriseanu AI, Dudeney J, et al. A meta-analytic review of randomized clinical trials of online treatments for anxiety: inclusion/exclusion criteria, uptake, adherence, dropout, and clinical outcomes. J Anxiety Disord. Dec 2022;92:102638. [CrossRef] [Medline]
  14. Cross SP, Karin E, Staples LG, Bisby MA, Ryan K, Duke G, et al. Factors associated with treatment uptake, completion, and subsequent symptom improvement in a national digital mental health service. Internet Interv. Mar 2022;27:100506. [FREE Full text] [CrossRef] [Medline]
  15. Beatty L, Kemp E, Koczwara B. Finding my way from clinical trial to open access dissemination: comparison of uptake, adherence, and psychosocial outcomes of an online program for cancer-related distress. Support Care Cancer. Jun 22, 2022;30(10):7935-7942. [CrossRef]
  16. Fleming T, Bavin L, Lucassen M, Stasiak K, Hopkins S, Merry S. Beyond the trial: systematic review of real-world uptake and engagement with digital self-help interventions for depression, low mood, or anxiety. J Med Internet Res. Jun 06, 2018;20(6):e199. [FREE Full text] [CrossRef] [Medline]
  17. Lipschitz JM, Van Boxtel R, Torous J, Firth J, Lebovitz JG, Burdick KE, et al. Digital mental health interventions for depression: scoping review of user engagement. J Med Internet Res. Oct 14, 2022;24(10):e39204. [FREE Full text] [CrossRef] [Medline]
  18. Klein B, Cook S. Preferences for e-mental health services amongst an online Australian sample? E J Appl Psychol. May 25, 2010;6(1):28-39. [CrossRef]
  19. Wallin EE, Mattsson S, Olsson EM. The preference for internet-based psychological interventions by individuals without past or current use of mental health treatment delivered online: a survey study with mixed-methods analysis. JMIR Ment Health. 2016;3(2):e25. [FREE Full text] [CrossRef] [Medline]
  20. Davies F, Shepherd HL, Beatty L, Clark B, Butow P, Shaw J. Implementing web-based therapy in routine mental health care: systematic review of health professionals' perspectives. J Med Internet Res. Jul 23, 2020;22(7):e17362. [FREE Full text] [CrossRef] [Medline]
  21. van der Vaart R, Witting M, Riper H, Kooistra L, Bohlmeijer ET, van Gemert-Pijnen LJ. Blending online therapy into regular face-to-face therapy for depression: content, ratio and preconditions according to patients and therapists using a Delphi study. BMC Psychiatry. Dec 14, 2014;14:355. [CrossRef] [Medline]
  22. Wentzel J, van der Vaart R, Bohlmeijer ET, van Gemert-Pijnen JE. Mixing online and face-to-face therapy: how to benefit from blended care in mental health care. JMIR Ment Health. Feb 09, 2016;3(1):e9. [FREE Full text] [CrossRef] [Medline]
  23. Kooistra LC, Ruwaard J, Wiersma JE, van Oppen P, van der Vaart R, van Gemert-Pijnen JE, et al. Development and initial evaluation of blended cognitive behavioural treatment for major depression in routine specialized mental health care. Internet Interv. May 2016;4:61-71. [FREE Full text] [CrossRef] [Medline]
  24. Erbe D, Eichert HC, Riper H, Ebert DD. Blending face-to-face and internet-based interventions for the treatment of mental disorders in adults: systematic review. J Med Internet Res. Sep 15, 2017;19(9):e306. [FREE Full text] [CrossRef] [Medline]
  25. Fitzpatrick M, Nedeljkovic M, Abbott JA, Kyrios M, Moulding R. "Blended" therapy: the development and pilot evaluation of an internet-facilitated cognitive behavioral intervention to supplement face-to-face therapy for hoarding disorder. Internet Interv. Jun 2018;12:16-25. [FREE Full text] [CrossRef] [Medline]
  26. Kooistra LC, Wiersma JE, Ruwaard J, Neijenhuijs K, Lokkerbol J, van Oppen P, et al. Cost and effectiveness of blended versus standard cognitive behavioral therapy for outpatients with depression in routine specialized mental health care: pilot randomized controlled trial. J Med Internet Res. Oct 29, 2019;21(10):e14261. [FREE Full text] [CrossRef] [Medline]
  27. Kleiboer A, Smit J, Bosmans J, Ruwaard J, Andersson G, Topooco N, et al. European COMPARative effectiveness research on blended depression treatment versus treatment-as-usual (E-COMPARED): study protocol for a randomized controlled, non-inferiority trial in eight European countries. Trials. Aug 03, 2016;17(1):387. [FREE Full text] [CrossRef] [Medline]
  28. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. Mar 29, 2021;372:n71. [CrossRef] [Medline]
  29. Covidence systematic review software. Veritas Health Innovation. URL: https://www.covidence.org/ [accessed 2024-04-29]
  30. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. Jan 2006;3(2):77-101. [CrossRef]
  31. Neuendorf KA. The Content Analysis Guidebook. 2nd edition. Thousand Oaks, CA. Sage Publications; 2017.
  32. Comprehensive meta-analysis. Version 4. Biostat, Inc. 2022. URL: https://meta-analysis.com/ [accessed 2024-04-29]
  33. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. Jun 2000;56(2):455-463. [CrossRef] [Medline]
  34. Study quality assessment tools. The National Heart, Lung, and Blood Institute (NHLBI). 2021. URL: https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools [accessed 2024-04-29]
  35. CASP checklist: CASP qualitative studies checklist. Critical Appraisal Skills Programme. URL: https://casp-uk.net/casp-tools-checklists/qualitative-studies-checklist/ [accessed 2024-04-29]
  36. Hong Q, Pluye P, Fàbregues S, Bartlett G, Boardman F. Mixed methods appraisal tool (MMAT) version 2018. Department of Family Medicine. 2018. URL: http:/​/mixedmethodsappraisaltoolpublic.​pbworks.com/​w/​file/​fetch/​127916259/​MMAT_2018_criteria-manual_2018-08-01_ENG.​pdf [accessed 2024-04-29]
  37. Høifødt RS, Lillevoll KR, Griffiths KM, Wilsgaard T, Eisemann M, Waterloo K, et al. The clinical effectiveness of web-based cognitive behavioral therapy with face-to-face therapist support for depressed primary care patients: randomized controlled trial. J Med Internet Res. Aug 2013;15(8):e153. [FREE Full text] [CrossRef] [Medline]
  38. Kok RN, van Straten A, Beekman AT, Cuijpers P. Short-term effectiveness of web-based guided self-help for phobic outpatients: randomized controlled trial. J Med Internet Res. Sep 29, 2014;16(9):e226. [FREE Full text] [CrossRef] [Medline]
  39. Månsson KN, Skagius RE, Gervind E, Dahlin M, Andersson G. Development and initial evaluation of an internet-based support system for face-to-face cognitive behavior therapy: a proof of concept study. J Med Internet Res. Dec 10, 2013;15(12):e280. [FREE Full text] [CrossRef] [Medline]
  40. Månsson KN, Klintmalm H, Nordqvist R, Andersson G. Conventional cognitive behavioral therapy facilitated by an internet-based support system: feasibility study at a psychiatric outpatient clinic. JMIR Res Protoc. Aug 24, 2017;6(8):e158. [FREE Full text] [CrossRef] [Medline]
  41. Romijn G, Provoost S, Batelaan N, Koning J, van Balkom A, Riper H. Does it blend? Exploring therapist fidelity in blended CBT for anxiety disorders. Internet Interv. Sep 2021;25:100418. [FREE Full text] [CrossRef] [Medline]
  42. Jacmon J, Malouff JM, Taylor N. Treatment of major depression: effectiveness of cognitive behavior therapy with an internet course as a central component. E J Appl Psychol. 2009;5(2):1-8. [CrossRef]
  43. Askjer S, Mathiasen K. The working alliance in blended versus face-to-face cognitive therapy for depression: a secondary analysis of a randomized controlled trial. Internet Interv. Sep 2021;25:100404. [FREE Full text] [CrossRef] [Medline]
  44. Mathiasen K, Andersen TE, Lichtenstein MB, Ehlers LH, Riper H, Kleiboer A, et al. The clinical effectiveness of blended cognitive behavioral therapy compared with face-to-face cognitive behavioral therapy for adult depression: randomized controlled noninferiority trial. J Med Internet Res. Sep 07, 2022;24(9):e36577. [FREE Full text] [CrossRef] [Medline]
  45. Berger T, Krieger T, Sude K, Meyer B, Maercker A. Evaluating an e-mental health program ("deprexis") as adjunctive treatment tool in psychotherapy for depression: results of a pragmatic randomized controlled trial. J Affect Disord. Dec 2018;227:455-462. [CrossRef] [Medline]
  46. Bisson JI, Ariti C, Cullen K, Kitchiner N, Lewis C, Roberts NP, et al. Guided, internet based, cognitive behavioural therapy for post-traumatic stress disorder: pragmatic, multicentre, randomised controlled non-inferiority trial (RAPID). BMJ. Jun 16, 2022;377:e069405. [FREE Full text] [CrossRef] [Medline]
  47. Cloitre M, Amspoker AB, Fletcher TL, Hogan JB, Jackson C, Jacobs A, et al. Comparing the ratio of therapist support to internet sessions in a blended therapy delivered to trauma-exposed veterans: quasi-experimental comparison study. JMIR Ment Health. Apr 27, 2022;9(4):e33080. [FREE Full text] [CrossRef] [Medline]
  48. Duffy D, Enrique A, Connell S, Connolly C, Richards D. Internet-delivered cognitive behavior therapy as a prequel to face-to-face therapy for depression and anxiety: a naturalistic observation. Front Psychiatry. Jan 9, 2019;10:902. [FREE Full text] [CrossRef] [Medline]
  49. Etzelmueller A, Radkovsky A, Hannig W, Berking M, Ebert DD. Patient's experience with blended video- and internet based cognitive behavioural therapy service in routine care. Internet Interv. Jun 2018;12:165-175. [FREE Full text] [CrossRef] [Medline]
  50. Kemmeren LL, van Schaik A, Smit JH, Ruwaard J, Rocha A, Henriques M, et al. Unraveling the black box: exploring usage patterns of a blended treatment for depression in a multicenter study. JMIR Ment Health. Jul 25, 2019;6(7):e12707. [FREE Full text] [CrossRef] [Medline]
  51. Kenter R, Warmerdam L, Brouwer-Dudokdewit C, Cuijpers P, van Straten A. Guided online treatment in routine mental health care: an observational study on uptake, drop-out and effects. BMC Psychiatry. Jan 31, 2013;13:43. [FREE Full text] [CrossRef] [Medline]
  52. Kenter RM, van de Ven PM, Cuijpers P, Koole G, Niamat S, Gerrits RS, et al. Costs and effects of internet cognitive behavioral treatment blended with face-to-face treatment: results from a naturalistic study. Internet Interv. Mar 2015;2(1):77-83. [CrossRef]
  53. Kooistra L, Ruwaard J, Wiersma J, van Oppen P, Riper H. Working alliance in blended versus face-to-face cognitive behavioral treatment for patients with depression in specialized mental health care. J Clin Med. Jan 27, 2020;9(2):347. [FREE Full text] [CrossRef] [Medline]
  54. Lungu A, Jun JJ, Azarmanesh O, Leykin Y, Chen CE. Blended care-cognitive behavioral therapy for depression and anxiety in real-world settings: pragmatic retrospective study. J Med Internet Res. Jul 06, 2020;22(7):e18723. [FREE Full text] [CrossRef] [Medline]
  55. Ly KH, Topooco N, Cederlund H, Wallin A, Bergström J, Molander O, et al. Smartphone-supported versus full behavioural activation for depression: a randomised controlled trial. PLoS One. May 26, 2015;10(5):e0126559. [FREE Full text] [CrossRef] [Medline]
  56. Mol M, Dozeman E, Provoost S, van Schaik A, Riper H, Smit JH. Behind the scenes of online therapeutic feedback in blended therapy for depression: mixed-methods observational study. J Med Internet Res. May 03, 2018;20(5):e174. [FREE Full text] [CrossRef] [Medline]
  57. Nakao S, Nakagawa A, Oguchi Y, Mitsuda D, Kato N, Nakagawa Y, et al. Web-based cognitive behavioral therapy blended with face-to-face sessions for major depression: randomized controlled trial. J Med Internet Res. Sep 21, 2018;20(9):e10743. [FREE Full text] [CrossRef] [Medline]
  58. Romijn G, Batelaan N, Koning J, van Balkom A, de Leeuw A, Benning F, et al. Acceptability, effectiveness and cost-effectiveness of blended cognitive-behavioural therapy (bCBT) versus face-to-face CBT (ftfCBT) for anxiety disorders in specialised mental health care: a 15-week randomised controlled trial with 1-year follow-up. PLoS One. 2021;16(11):e0259493. [FREE Full text] [CrossRef] [Medline]
  59. Tarp K, Nielsen AS. Patient perspectives on videoconferencing-based treatment for alcohol use disorders. Alcohol Treat Q. Jul 17, 2017;35(4):344-358. [CrossRef]
  60. Thase ME, Wright JH, Eells TD, Barrett MS, Wisniewski SR, Balasubramani G, et al. Improving the efficiency of psychotherapy for depression: computer-assisted versus standard CBT. Am J Psychiatry. Mar 01, 2018;175(3):242-250. [FREE Full text] [CrossRef] [Medline]
  61. van de Wal M, Thewes B, Gielissen M, Speckens A, Prins J. Efficacy of blended cognitive behavior therapy for high fear of recurrence in breast, prostate, and colorectal cancer survivors: the SWORD study, a randomized controlled trial. J Clin Oncol. Jul 01, 2017;35(19):2173-2183. [CrossRef] [Medline]
  62. Vernmark K, Hesser H, Topooco N, Berger T, Riper H, Luuk L, et al. Working alliance as a predictor of change in depression during blended cognitive behaviour therapy. Cogn Behav Ther. Jul 29, 2019;48(4):285-299. [FREE Full text] [CrossRef] [Medline]
  63. Witlox M, Garnefski N, Kraaij V, de Waal MW, Smit F, Bohlmeijer E, et al. Blended acceptance and commitment therapy versus face-to-face cognitive behavioral therapy for older adults with anxiety symptoms in primary care: pragmatic single-blind cluster randomized trial. J Med Internet Res. Mar 26, 2021;23(3):e24366. [FREE Full text] [CrossRef] [Medline]
  64. Wu MS, Chen SY, Wickham RE, O'Neil-Hart S, Chen C, Lungu A. Outcomes of a blended care coaching program for clients presenting with moderate levels of anxiety and depression: pragmatic retrospective study. JMIR Ment Health. Oct 21, 2021;8(10):e32100. [FREE Full text] [CrossRef] [Medline]
  65. Wu MS, Wickham RE, Chen SY, Chen C, Lungu A. Examining the impact of digital components across different phases of treatment in a blended care cognitive behavioral therapy intervention for depression and anxiety: pragmatic retrospective study. JMIR Form Res. Dec 17, 2021;5(12):e33452. [FREE Full text] [CrossRef] [Medline]
  66. Barkham M, Connell J, Stiles WB, Miles JN, Margison F, Evans C, et al. Dose-effect relations and responsive regulation of treatment duration: the good enough level. J Consult Clin Psychol. 2006;74(1):160-167. [CrossRef]
  67. Pauley D, Cuijpers P, Papola D, Miguel C, Karyotaki E. Two decades of digital interventions for anxiety disorders: a systematic review and meta-analysis of treatment effectiveness. Psychol Med. Jan 28, 2023;53(2):567-579. [FREE Full text] [CrossRef] [Medline]
  68. Titzler I, Saruhanjan K, Berking M, Riper H, Ebert DD. Barriers and facilitators for the implementation of blended psychotherapy for depression: a qualitative pilot study of therapists' perspective. Internet Interv. Jun 2018;12:150-164. [FREE Full text] [CrossRef] [Medline]
  69. Doukani A, Free C, Araya R, Michelson D, Cerga-Pashoja A, Kakuma R. Practitioners' experience of the working alliance in a blended cognitive-behavioural therapy intervention for depression: qualitative study of barriers and facilitators. BJPsych Open. Jul 25, 2022;8(4):e142. [FREE Full text] [CrossRef] [Medline]
  70. Schuster R, Pokorny R, Berger T, Topooco N, Laireiter AR. The advantages and disadvantages of online and blended therapy: survey study amongst licensed psychotherapists in Austria. J Med Internet Res. Dec 18, 2018;20(12):e11007. [CrossRef] [Medline]
  71. Davies F, Harris M, Shepherd HL, Butow P, Beatty L, Kemp E, et al. Promise unfulfilled: implementing web-based psychological therapy in routine cancer care, a qualitative study of oncology health professionals' attitudes. Psychooncology. Jul 22, 2022;31(7):1127-1135. [CrossRef] [Medline]
  72. Luo C, Sanger N, Singhal N, Pattrick K, Shams I, Shahid H, et al. Addendum to a comparison of electronically-delivered and face to face cognitive behavioural therapies in depressive disorders: a systematic review and meta-analysis. EClinicalMedicine. Oct 2020;27:100580. [CrossRef]


BT: blended therapy
CBT: cognitive behavioral therapy
ES: effect size
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
RCT: randomized controlled trial


Edited by T de Azevedo Cardoso; submitted 05.06.23; peer-reviewed by S Rennick-Egglestone, G Waller; comments to author 08.10.23; revised version received 27.08.24; accepted 17.09.24; published 29.10.24.

Copyright

©Kelly Ferrao Nunes-Zlotkowski, Heather L Shepherd, Lisa Beatty, Phyllis Butow, Joanne Margaret Shaw. Originally published in the Interactive Journal of Medical Research (https://www.i-jmr.org/), 29.10.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Interactive Journal of Medical Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.i-jmr.org/, as well as this copyright and license information must be included.