Published on in Vol 12 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/40358, first published .
Strategies to Bridge Equitable Implementation of Telehealth

Strategies to Bridge Equitable Implementation of Telehealth

Strategies to Bridge Equitable Implementation of Telehealth

Viewpoint

1Center for Care Delivery and Outcomes Research, Minneapolis Veterans Affairs Health Care System, Minneapolis, MN, United States

2Department of Medicine, University of Minnesota, Minneapolis, MN, United States

3Center of Innovation to Accelerate Discovery and Practice Transformation, Durham Veterans Affairs Health Care System, Durham, NC, United States

4School of Nursing, Duke University, Durham, NC, United States

5Department of Psychiatry, Washington University School of Medicine, St Louis, MO, United States

6Kaiser Permanente Center for Health Research, Portland, OR, United States

7Herbert Wertheim School of Public Health and Human Longevity Science, University of California San Diego, La Jolla, CA, United States

8Department of Family Medicine and Community Health, Research Division, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, United States

9Rutgers Cancer Institute of New Jersey, New Brunswick, NJ, United States

10Stanford Cancer Institute, Stanford, CA, United States

11Department of Family Medicine and Adult & Child Consortium for Health Outcomes Research and Delivery Science, University of Colorado School of Medicine, University of Colorado Anschutz Medical Campus, Aurora, CO, United States

12Division of Public Health Sciences, Washington University School of Medicine, St Louis, MO, United States

Corresponding Author:

Allison M Gustavson, DPT, PhD

Center for Care Delivery and Outcomes Research

Minneapolis Veterans Affairs Health Care System

1 Veterans Drive

Minneapolis, MN, 55417

United States

Phone: 1 612 467 3406

Fax:1 612 727 5699

Email: allison.gustavson@va.gov


During the COVID-19 pandemic, the rapid scaling of telehealth limited the extent to which proactive planning for equitable implementation was possible. The deployment of telehealth will persist in the postpandemic era, given patient preferences, advances in technologies, growing acceptance of telehealth, and the potential to overcome barriers to serve populations with limited access to high-quality in-person care. However, aspects and unintended consequences of telehealth may leave some groups underserved or unserved, and corrective implementation plans that address equitable access will be needed. The purposes of this paper are to (1) describe equitable implementation in telehealth and (2) integrate an equity lens into actionable equitable implementation.

Interact J Med Res 2023;12:e40358

doi:10.2196/40358

Keywords



The COVID-19 pandemic catalyzed the rapid development, implementation, and scaling of telehealth, which we define for this commentary as the synchronous delivery of health care services by phone or video [1,2]. Prior to the pandemic, the implementation of telehealth was variable whereby providers, patients, and organizations could self-select to use telehealth (eg, opt-in if available). During the COVID-19 public health emergency, telehealth became the primary option for receipt of many health care services for most patients (eg, all-in). Rapid implementation often occurred with limited prior knowledge about telehealth and based on a selective sample of providers who were willing to offer it, often for only select problems that would be reimbursed, and with a selected sample of individuals who opted into using telehealth. As a result, significant gaps in equitable implementation exist given the rapid nature of the roll-out, which likely reinforces health disparities in health care access for already marginalized patient populations [3,4].

Implementation science plays a critical role in bridging the gap between the implementation of telehealth and equity. Implementation research involves understanding, evaluating, and providing strategies that enhance how much and how well telehealth is accessed, delivered, and received for the right patient at the right time [5]. This commentary addresses a gap in our understanding of how telehealth should be equitably implemented, adapted, and sustained to reach entire target populations (including those most in need or historically excluded) and diverse institutions (eg, high- and low-resourced institutions). It also highlights an urgent need to address unintended consequences of widespread telehealth and apply strategies to ameliorate inequity where possible. We present a broad perspective on equitable implementation of telehealth and provide discussion and recommendations through the literature, an illustrative example, and our own practical experiences. The specific purposes of this commentary are to (1) describe the importance of and nuances in equitable implementation in telehealth and (2) integrate an equity lens into actionable equitable implementation processes. Recognizing the complexities in equitable implementation of telehealth, we provide a perspective on how implementation can either exacerbate or proactively address inequity. Other authors have described inequalities in patients who have access to, use, and adhere to interventions and intervention inequalities if technology-based interventions are not equally effective for all [6]. The focus of this paper is not on the intervention but describes how adapting existing implementation frameworks have the potential to enhance equity-focused decision-making during implementation to facilitate equitable telehealth outcomes.


Implementation science extends its long focus on health equity [7-12] to play an essential role in understanding, adapting, and reevaluating the integration of telehealth [5,13]. While evidence-based interventions existed for telehealth practices in selected settings, contexts, and populations before the pandemic [14-17], the urgency with which these practices were adopted during the pandemic limited more deliberate evaluation of their expanded implementation. Of particular concern was the inability to consider the often sparse evidence available and to evaluate initial conditions of inequity and other contextual factors. Many systems adopted telehealth based on resources available, lessons learned from collaboration with other systems, and practical experience. This helped with the expediency required but did not allow for the careful consideration needed to avoid unintended consequences, including the potential to create or exacerbate inequities.

To guide equitable implementation, it is ideal to begin with a framework that accounts for social disadvantage and injustice [8,10,12,18,19]. Implementation frameworks [11]—particularly the Health Equity Implementation Framework by Woodward et al [7] and the Consolidated Framework for Implementation Research by Damschroder et al [20]—articulate conceptual models to understand determinants of health equity to better adapt interventions and implementation strategies. Other frameworks have focused specifically on digital equity [21,22]; of note is the Digital Health Equity Framework (DHEF) [23,24]. The DHEF considers the multilevel, ecological impact when digital determinants of health (how digital health technologies influence equity in health) interact with intermediate health factors (eg, environment, current health status, and health-related beliefs and behaviors) [25]. While these digital and equity-focused frameworks provide a critical foundation for identifying and measuring different factors related to health equity, we are still left with how to integrate this knowledge into equitable implementation strategies and evaluation of telehealth.


Our goal was to provide a broad perspective and guidance to health care systems and researchers on strategies to equitably use and evaluate the implementation of telehealth. We chose to illustrate our perspective by selecting and integrating exemplar frameworks that capture the rapid speed at which telehealth is being adopted and implemented across disciplines and health care settings, as well as contextual factors that might influence equitable outcomes. We also sought an integrated framework that could expand beyond understanding implementation determinants to describe processes by which equity or inequities are driven by the interaction with and context of the external and internal environments.

With these considerations, we integrated the EPIS (Exploration, Preparation, Implementation, and Sustainment) and DHEF to encapsulate equity within the process of implementation, where EPIS guides us in moving from concept to impact and the DHEF tells us where to focus if we want to impact equity (Figure 1) [25-28]. In addition, we wanted to focus on the iterative nature of implementation and the multiphase EPIS conceptualization fit this need especially well. The rapid cycle guidance provided by EPIS is advantageous in the case of telehealth as—for the most part—exploration and preparation phases were accelerated to rapidly move to emergency implementation during the initial stages of the pandemic and limited the ability to conduct a thorough community needs assessment.

EPIS encompasses a 4-phase implementation cycle (Exploration, Preparation, Implementation, and Sustainment) and describes implementation processes, inner and outer contextual factors, and bridging factors that facilitate the interplay between inner and outer factors through each of these phases [26]. For example, internal factors may be parsed out into organizational (eg, leadership decision-making, capacity, and resources to deliver telehealth) and individual levels (acceptability, technology skills and proficiency, and literacy). External factors may include federal or state policies and reimbursement surrounding telehealth, investment in digital infrastructure (eg, technical support and equipment), and reimbursement policies around what providers can deliver telehealth and in what instances.

The DHEF adds an equity focus to the internal and external factors in EPIS [29]. The DHEF was developed to consider the multilevel health equity factors that can reduce or exacerbate disparities in access to and receipt of digital health technologies (eg, telehealth, mobile health apps, web-based health services, and wearable technologies) [23]. Importantly, the DHEF expands upon the concept that the health system is a social determinant of health, and therefore, organizations or systems need to look beyond patient-level factors to truly lead the implementation of telehealth with equity. When integrated with EPIS, we start to regroup internal and external factors into the health system as a social determinant of health and socioeconomic and cultural contexts, respectively (Figure 1). In this way, we capture both the (1) general implementation determinants (access to care, quality, and safety) [29] and equity determinants (eg, access, training, and equity-focused measurement) within the health care system and (2) the intermediate factors (eg, psychosocial stressors, health-related beliefs) and digital determinants (eg, access to digital resources, digital health literacy, and digital capacity building) in the broader societal context.

The integration of EPIS and the DHEF informs equitable implementation in telehealth by considering who can or cannot (1) access telehealth, (2) receive telehealth, and (3) deliver telehealth and why. An understanding of who in the population is not reached and why they may have been excluded can lead to diverse community and health system engagement and offer contextual adaptations to the telehealth clinical practice and implementation strategy.

Figure 1. Critical bridging solutions to equitable telehealth implementation that integrate the EPIS (Exploration, Preparation, Implementation, and Sustainment) and the Digital Health Equity Framework.

Overview

EPIS contains “bridging factors,” which consider and account for the interconnectedness and bidirectional nature of movement within and across internal and external factors that shape telehealth access, receipt, and delivery [26,28,30]. Instead of exploring internal and external contexts separately, bridging factors examine the interdependence of how external forces shape health systems and vice versa. While not explicitly cited as a bridging factor in the original EPIS model, we surmise that equity is a product of critical bridging factors that tie together various levels of context (potential drivers of inequities) important to telehealth implementation. For instance, complex dynamics of oppression and injustice may be operating on multiple levels (eg, ideological, internalized, interpersonal, and institutional) that require proactive, aligned bridging strategies to overcome [31-33].

In Figure 1, we propose 3 bridging solutions whose presence supports equity of telehealth access, receipt, and delivery: community partnerships, shared mental models, and digital infrastructure. These bridging solutions connect equity concepts of the health system as a social determinant of health and socioeconomic and cultural contexts (DHEF) over the course of an implementation process (EPIS). First, fostering community partnerships are the backbone of successful implementation research and can create the bidirectional flow of information necessary to align telehealth goals across care systems, individuals, and national or state policies. Second, communicating mental models nurtures the sharing of an interrelated set of beliefs that shapes a person’s expectations for the future and how they understand the ways the world works [34,35]. When mental models are shared across systems, challenges that were seen as intractable can be resolved to achieve a common care delivery improvement goal (eg, improve access to underserved populations) [28,35]. Finally, bolstering digital infrastructure bridges an organization’s human and technical resources to provide telehealth with a focus on advocacy at federal or state levels to incentivize payers to reimburse telehealth and invest in digital infrastructure. In future, if rapid deployment suggests bridging factors as key considerations for the equitable implementation of telehealth. Table 1 outlines a guide to questions that promote bridging solutions for the equitable implementation of telehealth.

Table 1. Guide to questions that promote bridging solutions for equitable implementation of telehealth.
Bridging issues for future explorationQuestion for future research
Population
  • Patients who do not use, or minimally use, telehealth in health care delivery
  • Patients who experience challenges to health and wellness due to sociodemographic factors
  • Patients who experience intersecting health and sociodemographic factors

  • What is the impact of (age, sex, race/ethnicity) on telehealth reach?
  • What are the factors of patients who do not (receive, sustain, engage in) telehealth?
  • What (resources such as interpreters, accessible devices) are necessary for equitable implementation of telehealth?
  • What structural factors (eg, racism) impact the equitable use of telehealth in a population?
Setting
  • Community-based health settings
  • Outpatient settings (eg, community-based clinics, large health care systems, small health care settings, rural clinics)
  • Primary care or specialty settings
  • What contextual factors influence equitable delivery of telehealth at the (person, provider, health care system) level?
  • What factors promote or hinder equitable implementation of (telehealth modality) at the (setting) level?
  • In what ways does (setting) impact the delivery and receipt of (telehealth modality)?
  • How does the implementation of telehealth differ by local or national (policy, available infrastructure)?
  • How does adaptation of (telehealth modality) interventions differ by setting?

Outcomes
  • Patient-centered outcomes
  • Acceptability of telehealth (eg, access, use, sustainment)
  • Patient and clinician satisfaction
  • Harms and unintended consequences (eg, missed diagnoses, nonengagement of certain groups or individuals)

  • How are outcomes culturally or contextually defined in telehealth use?
  • How do patient-reported outcomes differ by (patient characteristic, subgroup)?
  • What patient-reported outcomes differ by (patient characteristic, subgroup)?

Case Scenario

We offer a case scenario that illustrates the implementation phase of EPIS and considerations for equitable telehealth as outlined by DHEF. We first illustrate the health system as a social determinant of health and socioeconomic and cultural contexts defined by DHEF that drive the multilevel context in which the delivery of web-based physical therapy evolved over the pandemic. During the initial weeks of the COVID-19 pandemic in the United States, in-person services provided by outpatient physical therapists were immediately discontinued. Outpatient physical therapists across a multitude of health care systems and clinic networks transitioned from almost 100% in-person visits to almost 100% web-based visits in a matter of weeks [36,37]. This shift was significant in the physical therapy profession as prepandemic restrictions in the adoption of telehealth included both internal and external factors: reimbursement challenges, lack of organizational infrastructure to support web-based platforms of care, and limited provider education and training in web-based delivery of physical therapy services hampered widespread adoption of telehealth [38-40]. Additionally, before the pandemic, the physical therapy profession was already grappling with disparities in access to in-person physical therapy due to reduced staffing capacity. Staffing issues, in turn, precipitated long waitlists and high out-of-pocket costs for patients due to restrictive insurance policies for reimbursement of specialty physical therapy care [41-44]. Therefore, the quick deployment of telehealth may have further underscored unequal access for patients already experiencing challenges in receiving physical therapy care before the pandemic.

As the pandemic has progressed, so has the phased reopening of outpatient physical therapy services for in-person care. However, the value of telehealth—for example, the potential for expanded access and decreased transportation burden—has created momentum to continue the provision of physical therapy care via web-based modalities [38,45]. An operational response in some health care systems was to create threshold goals for the percentage of patients receiving in-person physical therapy care. For example, outpatient physical therapy clinics were expected to perform, say on average, 60% of visits as in-person care by a specified date in the phased reopening. Some health care systems and clinics have used additional policies that dictate a web-based visit must be initiated before an in-person visit, thus requiring the use of telehealth for entry into a physical therapy care pathway. In addition, it is important to note that the demand for these services may have increased during this period of time as well as the number of individuals seeking care due to rehabilitation after COVID-19 infection [46,47].

The context described above impacts groups at multiple levels and creates opportunities to enhance equity in the delivery of web-based physical therapy. As such, to consider further adaptations to and appropriate sustainment of web-based physical therapy care, we describe the bridging factors necessary to promote equitable implementation. First, establishing community partnerships is needed to engage patients, families, providers, and communities to better identify (needs assessment) who receives physical therapy (or not) when telehealth is offered and why. Methods to build community partnerships in implementation research offer opportunities for reflexivity and iteration, which informs strategies to ensure whether telehealth is delivered in a manner that is fair and just. For example, Miller et al [37] showed that patients reached by telehealth delivery of physical therapy during the pandemic were largely younger than 65 years, non-Hispanic White, English-speaking, commercially insured, and with few to no comorbidities. This contrasted with the distribution of patient characteristics seen for in-person physical therapy the year prior to the pandemic, many of whom were older than 65 years, Asian, non–English-speaking, noncommercially insured, and had at least 1 comorbidity. Community partnerships may enhance equitable implementation through the adaptation of physical therapy telehealth to the sociocultural context, thereby increasing the relevance of telehealth to marginalized patient populations and enhancing individual functional outcomes. Community partnerships between patients, providers, and operations are also needed to evaluate organizational capacity to provide both in-person and telehealth options based on patient needs and preferences.

Second, communicating shared mental models within and across systems and sectors allows groups of people delivering, receiving, or being impacted by physical therapy telehealth to be on the same page regarding equitable implementation. Telehealth delivery of physical therapy will likely persist post pandemic and adjusting how patients, providers, and systems perceive this new reality is essential to promoting equitable implementation. Discordant mental models may unintentionally hinder access to any modality of care such as in the case example where system or clinic policies drive the (1) proportion of telehealth versus in-person appointments available and (2) type of appointment necessary for entry into the care pathway. For example, individuals without stable internet access in a secure, private setting may be unable to engage in physical therapy if telehealth is initially required for entry into that service. Additionally, some patients may feel more comfortable receiving in-person care in a physical therapy clinic during which they can discuss sensitive topics influencing their recovery and feel less vulnerable undressing or exposing certain areas of their body for examination. Alternatively, some patients may feel more comfortable discussing sensitive topics in their own homes, thus creating an inviting atmosphere for greater sharing and conversation between patient and provider.

Convening a diverse group of community members can help build a shared mental model by asking questions such as the following: what proportion of telehealth visits per provider reaches the most patients? What is considered a successful telehealth episode of care? What criteria indicate other modalities of care be considered? Mapping clinic workflow is also essential for identifying gaps where patients may be unable or do not receive the necessary physical therapy services in a timely manner. Practice facilitation may be one strategy to allow physical therapists in a health care system to internalize approaches to ensure the right patient has access to the right modality of care at the right time [48,49]. Practice facilitation is an intervention where an external or internal facilitator interacts with multilevel stakeholders and can offer tools, resources, expertise, and guidance on strategies that address gaps and optimize workflow. Importantly, practice facilitation in the context of web-based physical therapy care can develop an internal capacity for change that can transcend the delivery of telehealth to be adaptive and receptive to evaluating and promoting equitable implementation.

Third, building digital infrastructure at multiple levels is necessary to ensure any patient who would benefit from physical therapy services has the option to participate in telehealth, if clinically appropriate and it aligns with patient preferences. To understand the baseline level of infrastructure, research is needed to measure (1) individual-level factors such as technology skills and proficiency, equipment availability, acceptability, and preferences for care and (2) community-level metrics such as neighborhood availability of Wi-Fi or broadband and transportation to in-person appointments. This information and ongoing evaluation inform policies and oversight of policy implementation. Building a digital infrastructure is interconnected with establishing community partnerships and communicating shared mental models as the infrastructure involves cross-sector collaborations for resources, governance, and continual monitoring. An opportunity exists to co-design or adapt aspects of digital infrastructure to better meet the needs of all patients who would benefit from physical therapy care, clinicians providing physical therapy, and health systems offering physical therapy services. To be truly successful, a digital infrastructure must develop a plan for transparency and sharing of data, engage the community throughout the infrastructure planning and implementation, and manage data privacy and security [50]. A strong digital infrastructure can provide the foundation to expand the equitable implementation of telehealth to other health and community services.


Future Directions and Recommendations Post Pandemic

Deployment of telehealth will likely persist in the post pandemic era, given patient preferences for such care, emerging advances in technologies, paradigm shifts in health care professional training, and the potential to serve populations with limited potential for high-quality in-person care (eg, residents of rural areas and patients who are homebound) [21,51]. Reevaluating and adapting telehealth to promote equitable implementation is one way to identify patient groups who may be harmed by the web-based delivery of services or those who may be negatively impacted by a full return to non-telehealth delivery. We recommend evaluating the ongoing and future implementation of telehealth by (1) evaluating hybrid care models, (2) identifying multilevel barriers and facilitators to adapting technology resources that enhance access and use across diverse populations, and (3) exploring the intersectionality of telehealth access and usage with respect to age, race, ethnicity, sexual orientation, disability (including visual and hearing impairments), socioeconomic status, social determinants of health, digital health literacy and numeracy, or residence in rural or urban settings. Bridging issues outlined in Table 1 can be alleviated through bridging solutions (Figure 1): establishing community partnerships, communicating shared mental models, and building digital infrastructure.

First, establishing community partnerships (including those often excluded or marginalized) is the intentional and meaningful involvement of impacted community members to understand key issues and problem solving [12,52]. Feedback loops among implementation actors at multiple levels—patients, providers, clinical/health care system leadership, and policy makers—are needed to capture the barriers, facilitators, and unintended consequences to delivering or receiving telehealth, thus enabling a stronger understanding of who is impacted by telehealth delivery and how. At the organizational and policy level, assessing organizational readiness to support multiple modalities and options for care delivery is necessary to honor individual preferences for care while minimizing disruption to clinic workflow [53,54]. We acknowledge that considerable time, support, and relationship building with impacted community members is needed when conducting equitable implementation research. The time, effort, burden, and compatibility with workflow need to be periodically evaluated and modified as needed to make equitable implementation of telehealth sustainable. Future areas of evaluation highlight the need to describe how patient and multilevel partners and contextual factors can impact the uptake and adoption of telehealth through mediation or moderation. Specifically, future work is necessary to examine the uptake and adoption of telehealth by population and setting (high vs low resourced) to promote equitable use of telehealth in health care. Second, shared mental models between those impacted by telehealth adoption can determine the level of telehealth they are willing to accept and what changes—such as adaptations to implementation—they may consider for enhanced equity [34,35]. Adaptations are also an important aspect to maximizing equitable implementation by minimizing unintended consequences. For example, systems or clinics may need to integrate assessments of health/technology literacy/numeracy [55-57] into routine clinical care and then create or adopt interventions that address identified gaps. Additionally, for equitable implementation of telehealth, systems or clinics must identify the characteristics of their catchment area that go beyond individual factors (eg, space to complete movement assessments in the home, privacy for web-based connections with physical therapists) to include care delivery constraints (eg, beginning sessions late and running over time of scheduled appointment). Patient, clinical providers, health care systems, and communities need a shared mental model of such adaptations to collectively understand the role and impact of changes on telehealth access, receipt, and delivery. Holtrop et al [35] provide a useful table describing methods to elicit mental models. Understanding mental models can help to select potential implementation strategies needed to promote the equitable implementation of telehealth across a variety of disciplines [35,58,59].

Finally, as we approach postpandemic implementation of telehealth, building a digital infrastructure has the potential to mitigate long-standing issues with the inverse relationship between the need for health care and use or access [55] across different populations. Building a digital infrastructure requires attention to engagement, access, training (including cultural humility), and equity-focused measurement [25,60,61]. Future research needs to evaluate the cost-effectiveness of telehealth that includes policy analysis and program evaluation related to the construction and sustainment of digital infrastructure in communities.


Enhancing equitable implementation of telehealth is timely and critical to advancing the health and well-being of all persons. The tension between ongoing innovation in telehealth that is occurring in the context of the evolving pandemic creates opportunities for innovation and unanticipated challenges to equitable implementation. Equity frameworks help connect internal and external contexts that create disparities and to consider the implementation strategies that may address them. Bridging factors such as community partnerships, shared mental models, and digital infrastructure can guide implementation, adaptations, and sustainability in the setting of a rapidly changing landscape for telehealth.

Acknowledgments

The authors gratefully acknowledge Shelly Johnston, MPH, RD, and Kirsten K Davison, PhD, MS, for their support and feedback during the development and execution of this project. We also thank Emily Hudson for assistance in editing and formatting for the overall improvement of the manuscript. The Institute for Implementation Science Scholars (IS-2) is supported by funding from the National Institutes of Health (NIH) Office of Behavioral and Social Sciences Research (OBSSR) and Office of Disease Prevention, administered by the National Institute of Diabetes and Digestive and Kidney Disorders (R25DK123008, R25DK123008-S1) and the US Veterans Administration. AMG was partially supported during this work by the Agency for Healthcare Research and Quality (AHRQ) and Patient-Centered Outcomes Research Institute (PCORI; grant number K12HS026379); the National Institutes of Health’s National Center for Advancing Translational Sciences (grant number KL2TR002492); and the Minneapolis Center of Innovation, Center for Care Delivery and Outcomes Research (CIN 13-406). EEFC is supported by the National Institutes of Health (K08 MH120341). SEL was supported by the National Institutes of Health (K08 HS26517). AAL is supported by the Durham Center of Innovation to Accelerate Discovery and Practice Transformation (grant number CIN 13-410) at the Durham Veterans Affairs Health Care System, and Veteran Affair's Health Services Research and Development Service (VA HSR&D, grant number 18-234). DMO was supported during this work by National Cancer Institute (K99CA256043) and the Robert E Leet and Clara Guthrie Patterson Trust Mentored Research Award. REG was supported by the IS-2 program and the National Cancer Institute (NCI)-funded University of Colorado Implementation Science Center for Cancer Control (P50 CA244688). LMK was supported by the IS-2 Program (R25DK123008), and the NCI-funded Washington University Implementation Science Center for Cancer Control (P50 CA244431). The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the United States Government, AHRQ, PCORI, Duke University, or Minnesota Learning Health System Mentored Career Development Program (MN-LHS).

Authors' Contributions

All authors contributed to the conception and design of this work, drafted this work, substantively revised it, and approved the submitted version.

Conflicts of Interest

AAL reports receiving funding from Otsuka and the PhRMA Foundation not related to this work. EEFC serves on the clinical advisory board of Beanbag Health and receives consulting fees from Kooth. SEL began a position at Omada Health during the final preparation stage of this manuscript and this affiliation has no influence on the manuscript.

  1. Lewinski AA, Walsh C, Rushton S, Soliman D, Carlson SM, Luedke MW, et al. Telehealth for the longitudinal management of chronic conditions: systematic review. J Med Internet Res 2022;24(8):e37100. [CrossRef] [Medline]
  2. What is telehealth? Health Resources and Services Administration (HRSA). 2022.   URL: https://www.hrsa.gov/rural-health/topics/telehealth/what-is-telehealth [accessed 2023-04-28]
  3. Nouri S, Khoong EC, Lyles CR, Karliner L. Addressing equity in telemedicine for chronic disease management during the Covid-19 pandemic. NEJM Catalyst. 2020.   URL: https://catalyst.nejm.org/doi/full/10.1056/CAT.20.0123 [accessed 2023-04-28]
  4. Health equity in telehealth. Health Resources & Service Administration (HRSA). 2022.   URL: https://telehealth.hhs.gov/providers/health-equity-in-telehealth [accessed 2023-04-28]
  5. Bauer MS, Damschroder L, Hagedorn H, Smith J, Kilbourne AM. An introduction to implementation science for the non-specialist. BMC Psychol 2015;3(1):32 [FREE Full text] [CrossRef] [Medline]
  6. Veinot TC, Mitchell H, Ancker JS. Good intentions are not enough: how informatics interventions can worsen inequality. J Am Med Inform Assoc 2018;25(8):1080-1088 [FREE Full text] [CrossRef] [Medline]
  7. Woodward EN, Matthieu MM, Uchendu US, Rogal S, Kirchner JE. The health equity implementation framework: proposal and preliminary study of hepatitis C virus treatment. Implement Sci 2019;14(1):26 [FREE Full text] [CrossRef] [Medline]
  8. Baumann AA, Cabassa LJ. Reframing implementation science to address inequities in healthcare delivery. BMC Health Serv Res 2020;20(1):190 [FREE Full text] [CrossRef] [Medline]
  9. Galaviz KI, Breland JY, Sanders M, Breathett K, Cerezo A, Gil O, et al. Implementation science to address health disparities during the coronavirus pandemic. Health Equity 2020;4(1):463-467 [FREE Full text] [CrossRef] [Medline]
  10. Brownson RC, Kumanyika SK, Kreuter MW, Haire-Joshu D. Implementation science should give higher priority to health equity. Implement Sci 2021;16(1):28 [FREE Full text] [CrossRef] [Medline]
  11. Woodward EN, Singh RS, Ndebele-Ngwenya P, Melgar Castillo A, Dickson KS, Kirchner JE. A more practical guide to incorporating health equity domains in implementation determinant frameworks. Implement Sci Commun 2021;2(1):61 [FREE Full text] [CrossRef] [Medline]
  12. Kerkhoff AD, Farrand E, Marquez C, Cattamanchi A, Handley MA. Addressing health disparities through implementation science-a need to integrate an equity lens from the outset. Implement Sci 2022;17(1):13 [FREE Full text] [CrossRef] [Medline]
  13. Proctor EK, Geng E. A new lane for science. Science 2021;374(6568):659 [FREE Full text] [CrossRef] [Medline]
  14. Srinivasan M, Asch S, Vilendrer S, Thomas SC, Bajra R, Barman L, et al. Qualitative assessment of rapid system transformation to primary care video visits at an academic medical center. Ann Intern Med 2020;173(7):527-535 [FREE Full text] [CrossRef] [Medline]
  15. Eruchalu CN, Pichardo MS, Bharadwaj M, Rodriguez CB, Rodriguez JA, Bergmark RW, et al. The expanding digital divide: digital health access inequities during the COVID-19 pandemic in New York city. J Urban Health 2021;98(2):183-186 [FREE Full text] [CrossRef] [Medline]
  16. Litchfield I, Shukla D, Greenfield S. Impact of COVID-19 on the digital divide: a rapid review. BMJ Open 2021;11(10):e053440 [FREE Full text] [CrossRef] [Medline]
  17. Mohammed HT, Hyseni L, Bui V, Gerritsen B, Fuller K, Sung J, et al. Exploring the use and challenges of implementing virtual visits during COVID-19 in primary care and lessons for sustained use. PLoS One 2021;16(6):e0253665 [FREE Full text] [CrossRef] [Medline]
  18. Clare CA. Telehealth and the digital divide as a social determinant of health during the COVID-19 pandemic. Netw Model Anal Health Inform Bioinform 2021;10(1):26 [FREE Full text] [CrossRef] [Medline]
  19. Rhee K, Dankwa-Mullan I, Brennan V, Clark C. What is TechQuity? J Health Care Poor Underserved 2021;32(2S):xiii-xviii [FREE Full text] [CrossRef]
  20. Damschroder LJ, Reardon CM, Opra Widerquist MA, Lowery J. Conceptualizing outcomes for use with the consolidated framework for implementation research (CFIR): the CFIR outcomes addendum. Implement Sci 2022;17(1):7 [FREE Full text] [CrossRef] [Medline]
  21. Lyles CR, Wachter RM, Sarkar U. Focusing on digital health equity. JAMA 2021;326(18):1795-1796 [FREE Full text] [CrossRef] [Medline]
  22. Sieck CJ, Rastetter M, Hefner JL, Glover AR, Magaña C, Gray DM, et al. The Five A's of access for TechQuity. J Health Care Poor Underserved 2021;32(2):290-299 [FREE Full text] [CrossRef]
  23. Clark CR, Akdas Y, Wilkins CH, Rhee K, Johnson KB, Bates DW, et al. TechQuity is an imperative for health and technology business: let's work together to achieve it. J Am Med Inform Assoc 2021;28(9):2013-2016 [FREE Full text] [CrossRef] [Medline]
  24. Richardson S, Lawrence K, Schoenthaler AM, Mann D. A framework for digital health equity. NPJ Digit Med 2022;5(1):119 [FREE Full text] [CrossRef] [Medline]
  25. Crawford A, Serhal E. Digital health equity and COVID-19: the innovation curve cannot reinforce the social gradient of health. J Med Internet Res 2020;22(6):e19361 [FREE Full text] [CrossRef] [Medline]
  26. Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the exploration, preparation, implementation, sustainment (EPIS) framework. Implement Sci 2019;14(1):1 [FREE Full text] [CrossRef] [Medline]
  27. Moullin JC, Dickson KS, Stadnick NA, Albers B, Nilsen P, Broder-Fingert S, et al. Ten recommendations for using implementation frameworks in research and practice. Implement Sci Commun 2020;1:42 [FREE Full text] [CrossRef] [Medline]
  28. Lengnick-Hall R, Stadnick NA, Dickson KS, Moullin JC, Aarons GA. Forms and functions of bridging factors: specifying the dynamic links between outer and inner contexts during implementation and sustainment. Implement Sci 2021;16(1):34 [FREE Full text] [CrossRef] [Medline]
  29. Dover DC, Belon AP. The health equity measurement framework: a comprehensive model to measure social inequities in health. Int J Equity Health 2019;18(1):36 [FREE Full text] [CrossRef] [Medline]
  30. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health 2011;38(1):4-23 [FREE Full text] [CrossRef] [Medline]
  31. Potapchuk M, Leiderman S, Bivens D, Major B. Flipping the script: white privilege and community building. MP Associates, Inc, and the Center for Assessment and Policy Development (CAPD). 2005.   URL: https://www.mpassociates.us/uploads/3/7/1/0/37103967/flippingthescriptmostupdated.pdf [accessed 2023-04-28]
  32. Chinook F. The four "I's" of oppression. Association for University and College Counseling Center Outreach. 2010.   URL: http://auccco.com/resources/Documents/4isofoppression.pdf [accessed 2023-04-28]
  33. Madden P, Vera Cruz AC. Integrating Eisner's concepualization of curriculum with the four "I's" of systematic racism to promote anti-racist praxis in education and beyond. J Am Assoc Adv Curric Stud 2021;14(2):1-19 [FREE Full text]
  34. Gentner D, Stevens AL. Mental Models. New York: Psychology Press; 1983.
  35. Holtrop JS, Scherer LD, Matlock DD, Glasgow RE, Green LA. The importance of mental models in implementation science. Front Public Health 2021;9:680316 [FREE Full text] [CrossRef] [Medline]
  36. Hall JB, Luechtefeld JT, Woods ML. Adoption of telehealth by pediatric physical therapists during COVID-19: a survey study. Pediatr Phys Ther 2021;33(4):237-244 [FREE Full text] [CrossRef] [Medline]
  37. Miller MJ, Pak SS, Keller DR, Barnes DE. Evaluation of pragmatic telehealth physical therapy implementation during the COVID-19 pandemic. Phys Ther 2021;101(1):pzaa193 [FREE Full text] [CrossRef] [Medline]
  38. Grundstein MJ, Fisher C, Titmuss M, Cioppa-Mosca J. The role of virtual physical therapy in a post-pandemic world: pearls, pitfalls, challenges, and adaptations. Phys Ther 2021;101(9):pzab145 [FREE Full text] [CrossRef] [Medline]
  39. Lieneck C, Weaver E, Maryon T. Outpatient telehealth implementation in the United States during the COVID-19 global pandemic: a systematic review. Medicina (Kaunas) 2021;57(5):462 [FREE Full text] [CrossRef] [Medline]
  40. LeFevre ML. Behavioral counseling to promote a healthful diet and physical activity for cardiovascular disease prevention in adults with cardiovascular risk factors: U.S. preventive services task force recommendation statement. Ann Intern Med 2014;161(8):587-593 [FREE Full text] [CrossRef] [Medline]
  41. McCallum CA, DiAngelis T. Direct access: factors that affect physical therapist practice in the state of Ohio. Phys Ther 2012;92(5):688-706 [FREE Full text] [CrossRef] [Medline]
  42. Laliberté M, Williams-Jones B, Feldman DE, Hunt M. Ethical challenges for patient access to physical therapy: views of staff members from three publicly-funded outpatient physical therapy departments. Narrat Inq Bioeth 2017;7(2):157-169 [FREE Full text] [CrossRef] [Medline]
  43. Sandstrom R, Bruns A. Disparities in access to outpatient rehabilitation therapy for African Americans with arthritis. J Racial Ethn Health Disparities 2017;4(4):599-606 [FREE Full text] [CrossRef] [Medline]
  44. Curry EJ, Penvose IR, Knapp B, Parisien RL, Li X. National disparities in access to physical therapy after rotator cuff repair between patients with medicaid vs. private health insurance. JSES Int 2021;5(3):507-511 [FREE Full text] [CrossRef] [Medline]
  45. Lee AC. COVID-19 and the advancement of digital physical therapist practice and telehealth. Phys Ther 2020;100(7):1054-1057 [FREE Full text] [CrossRef] [Medline]
  46. Kim SY, Kumble S, Patel B, Pruski AD, Azola A, Tatini AL, et al. Managing the rehabilitation wave: rehabilitation services for COVID-19 survivors. Arch Phys Med Rehabil 2020;101(12):2243-2249 [FREE Full text] [CrossRef] [Medline]
  47. Albu S, Zozaya NR, Murillo N, García-Molina A, Chacón CAF, Kumru H. What's going on following acute COVID-19? Clinical characteristics of patients in an out-patient rehabilitation program. NeuroRehabilitation 2021;48(4):469-480 [FREE Full text] [CrossRef] [Medline]
  48. Ritchie MJ, Dollar KM, Miller CJ, Oliver KA, Smith JL, Lindsay JA, et al. Implementation facilitation training manual: using implementation faciliation to improve care in the Veterans Health Administration, version 2. Veterans Health Administration. 2017.   URL: http /Users/A9075/Downloads/implementation-facilitation-training-manual.pdf [accessed 2023-04-28]
  49. Frost MC, Ioannou GN, Tsui JI, Edelman EJ, Weiner BJ, Fletcher OV, et al. Practice facilitation to implement alcohol-related care in veterans health administration liver clinics: a study protocol. Implement Sci Commun 2020;1(1):68 [FREE Full text] [CrossRef] [Medline]
  50. Goldsmith S, Gardner B. Implementing digital infrastructure: responses to equity, sustainability, and safety. Data-Smart City Solutions. 2022.   URL: https://datasmart.hks.harvard.edu/implementing-digital-infrastructure [accessed 2023-04-28]
  51. Patel SY, Huskamp HA, Busch AB, Mehrotra A. Telemental health and US rural-urban differences in specialty mental health use, 2010-2017. Am J Public Health 2020;110(9):1308-1314 [FREE Full text] [CrossRef] [Medline]
  52. Fields J, Gutierrez JR, Marquez C, Rhoads K, Kushel M, Fernández A, et al. Community-academic partnerships to address covid-19 inequities: lessons from the San Francisco bay area. NEJM Catal Innov Care Deliv 2021;2(3):1-20 [FREE Full text] [CrossRef]
  53. Weiner BJ. A theory of organizational readiness for change. Implement Sci 2009;4:67 [FREE Full text] [CrossRef] [Medline]
  54. Kononowech J, Hagedorn H, Hall C, Helfrich CD, Lambert-Kerzner AC, Miller SC, et al. Mapping the organizational readiness to change assessment to the consolidated framework for implementation research. Implement Sci Commun 2021;2(1):19 [FREE Full text] [CrossRef] [Medline]
  55. Hart JT. The inverse care law. Lancet 1971;297(7696):405-412 [FREE Full text] [CrossRef] [Medline]
  56. Karnoe A, Furstrand D, Christensen KB, Norgaard O, Kayser L. Assessing competencies needed to engage with digital health services: development of the ehealth literacy assessment toolkit. J Med Internet Res 2018;20(5):e178 [FREE Full text] [CrossRef] [Medline]
  57. Oh SS, Kim KA, Kim M, Oh J, Chu SH, Choi J. Measurement of digital literacy among older adults: systematic review. J Med Internet Res 2021;23(2):e26145 [FREE Full text] [CrossRef] [Medline]
  58. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. Implement Sci 2015;10:21 [FREE Full text] [CrossRef] [Medline]
  59. Waltz TJ, Powell BJ, Fernández ME, Abadie B, Damschroder LJ. Choosing implementation strategies to address contextual barriers: diversity in recommendations and future directions. Implement Sci 2019;14(1):42 [FREE Full text] [CrossRef] [Medline]
  60. Sivashanker K, Duong T, Resnick A, Eappen S. Health care equity: from fragmentation to transformation. NEJM Catal Innov Care Deliv 2020;1(5):1-8 [FREE Full text] [CrossRef]
  61. Harrington R, Washington D, Paliani S, Thompson K, Rouse L, Anderson AC. A new effort to address racial and ethnic disparities in care through quality measurement. Health Affairs Forefront. 2021.   URL: https://www.healthaffairs.org/do/10.1377/forefront.20210907.568444/full/ [accessed 2023-04-28]


DHEF: Digital Health Equity Framework
EPIS: Exploration, Preparation, Implementation, and Sustainment


Edited by A Mavragani; submitted 16.06.22; peer-reviewed by J Satterfield, L Nelson, A Schoenthaler; comments to author 08.09.22; revised version received 08.12.22; accepted 30.03.23; published 15.05.23

Copyright

©Allison M Gustavson, Allison A Lewinski, Ellen E Fitzsimmons-Craft, Gloria D Coronado, Sarah E Linke, Denalee M O'Malley, Alyce S Adams, Russell E Glasgow, Lisa M Klesges. Originally published in the Interactive Journal of Medical Research (https://www.i-jmr.org/), 15.05.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Interactive Journal of Medical Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.i-jmr.org/, as well as this copyright and license information must be included.