Published on in Vol 12 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/42016, first published .
The Utility of Predictive Modeling and a Systems Process Approach to Reduce Emergency Department Crowding: A Position Paper

The Utility of Predictive Modeling and a Systems Process Approach to Reduce Emergency Department Crowding: A Position Paper

The Utility of Predictive Modeling and a Systems Process Approach to Reduce Emergency Department Crowding: A Position Paper

Authors of this article:

Ann Corneille Monahan1 Author Orcid Image ;   Sue S Feldman2 Author Orcid Image

Viewpoint

1University of Alabama at Birmingham, Birmingham, AL, United States

2Department of Health Services Administration, University of Alabama at Birmingham, Birmingham, AL, United States

Corresponding Author:

Ann Corneille Monahan, MSHI, PhD

University of Alabama at Birmingham

1720 University Blvd

Birmingham, AL, 35294

United States

Phone: 1 205 934 4011

Email: monahanannc@gmail.com


Emergency department (ED) crowding and its main causes, exit block and boarding, continue to threaten the quality and safety of ED care. Most interventions to reduce crowding have not been comprehensive or system solutions, only focusing on part of the care procession and not directly affecting boarding reduction. This position paper proposes that the ED crowding problem can be optimally addressed by applying a systems approach using predictive modeling to identify patients at risk of being admitted to the hospital and uses that information to initiate the time-consuming bed management process earlier in the care continuum, shortening the time during which patients wait in the ED for an inpatient bed assignment, thus removing the exit block that causes boarding and subsequently reducing crowding.

Interact J Med Res 2023;12:e42016

doi:10.2196/42016

Keywords



The Emergency Department Crowding Problem

The ED crowding problem occurs when the ED demand exceeds the staff’s ability to provide quality care in a reasonable period of time [1,2]. The literature suggests that hospital exit block [3,4] (ie, when patients cannot transition into the hospital from the ED because a hospital bed has not been assigned [3]) and ED boarding [5-8] (ie, when a patient due to be admitted to the hospital remains in the ED, occupying a bed [3]) are the main causes of ED crowding and posits that an impactful solution lies in changes in the bed management strategy, the processes involved in the transition of patients from the ED to the hospital, and when securing a hospital bed [9,10].

This position paper proposes that the complexities of the ED crowding problem can be optimally addressed by applying a systems approach to the hospital bed management strategy. The systems approach views an environment as a whole, which is made up of many parts or subsystems for the purpose of understanding the relationships between the system and its parts and to aid in problem-solving [11]. A systems approach that uses predictive modeling to identify patients who are at risk of being admitted to the hospital and uses that information to initiate the complex and time-consuming bed management process earlier in the care continuum could potentially shorten the time during which patients wait in the ED to be transitioned into an inpatient bed, thus removing the exit block that causes boarding and subsequently reducing crowding [12]. The challenges facing the health care industry are greater than ever before, with increasing complexities of care, regulations, and higher quality care expectations. At the same time, the industry is challenged to address preventable medical errors, poor amenable mortality rates, nursing and physician burnout and shortages, and general inefficiencies. These industry challenges are magnified in the ED where the nature and environment of emergency care cannot tolerate threats to quality care delivery or to patient and provider safety. A systems approach views the ED as a complex microcosm of a larger health ecosystem where optimal functionality requires that it be resilient to the unpredictable demands [13] characteristic of the urgent care environment. To manage new and unpredictable challenges, a systems approach can be used to address known threats. An efficient manner by which to accomplish this is to identify predictable and repeatable processes to which information technology can be applied.

Crowding and its main causes, exit block and boarding, have threatened the quality and safety of ED care for over 20 years despite the efforts of many to resolve it [14-16]. Boarding compromises care quality [3,17], stresses hospital operations [18], and strains resources because boarded patients occupy beds and divert staff resources from new and existing patients [17] and reduce revenue generation through the reduction in available beds for treating new patients [19].

The industry would benefit from improved approaches to resolve the crowding problem. The existing research focused on this problem suggests that predictive modeling holds promise to make a significant contribution toward addressing ED crowding; for example, models have predicted imminent hospital admissions for older ED patients [20], identified patients who are likely to require hospital care in the future [21], predicted ED crowding using calendar and weather variables [22], and forecasted ED flow digitally [23].

Applying Predictive Modeling to Resolve Crowding and Bed Management

Predictive modeling is a form of data mining technology that functions by analyzing historic and current data, and generating a model to help predict a future outcome [24]. It is an explicit, empirical approach for estimating the probabilities that an event will or will not occur in the future [25]—such as death, contracting a disease, surgical complications, or hospital admission—by using statistical techniques to predict future events. Models use data about patients, diseases, or treatment characteristics to estimate the probability that a condition or disease is present or the probability that an outcome will occur [26,27]. However, models are only just starting to be used to produce actionable information to impact operations and patient care. We posit that predictive models to identify patients who are at risk of being admitted could be applied in the bed manager environment to remove the exit block that causes boarding by initiating the bed management process earlier in the care continuum, thereby shortening the time during which patients wait in the ED for an inpatient bed assignment. This, in turn, reduces exit block, boarding, and subsequently crowding. As no clinical decisions are made on the basis of patients’ risk of admission, this process could be automated to streamline part of the complicated bed management process and take advantage of predictable and repeatable processes using standardized data.

Many interventions to reduce crowding have not been comprehensive or system solutions but rather focus on part of the care procession and do not directly affect boarding reduction [28]. However, existing interventions that addressed crowding as a systemic problem have reduced the time during which a patient is boarded in the ED [9,10,29], which, in turn, reduces the backlog of boarded patients who contribute to ED crowding. Interdepartmental collaboration with hospital management support was a feature in these interventions. Two of these interventions also used real-time ED data on congestion, flow, and patient admissions to prepare for and manage inpatient admissions and bed demand [9,29]. Individual interventions are parts of the system, rather than being considered a collective, and are automated to contribute valuable data to augment bed management.

The use of predictive models in health care have quadrupled over the last 2 decades and their accuracy has increased [12,28]. While these have traditionally been applied to identify risk, the time is right for integrating predictive models with existing technologies such as electronic health records, clinical decision support systems, and clinical data warehouses, to result in action and efficiencies. n 2019, the use of predictive modeling was reported among 60% of health care executives within their organizations, and another 20% of them expressed intent to begin using them the following year [30], again primarily for risk prediction and not necessarily action. This existing technological infrastructure holds promise to reduce prior barriers to integration. Moreover, as clinical care becomes increasingly personalized, aid from predictive analytics may become a best-practice procedure.

Concerns for Risk Models

Developing quality predictive models is challenging [28,31]. Deciding what variables to measure to answer a particular question can even be problematic. For example, if the goal is to predict “health,” which data are measured as indicators of health? The answer to this question varies. If rigorous study methods are not used throughout study development, data gathering, and analysis, there are numerous avenues for the model to make errors and lead to unintentional bias. Recent studies, including a systematic review of admission prediction models [28], have questioned the quality and rigor of existing predictive models [12,28,31-33] due to an overall lack of external validation studies [31], multiple prediction models for the same outcome or target population [26], and risks of bias [34-36]. A bias unique to predictive models, algorithmic bias, occurs when technology reflects the attitudes and values of the humans who coded, collected, selected, or used the data to train the algorithm [37]. Thus, machine-generated algorithms are human products executed by a machine. Algorithms should not be blindly trusted or considered neutral and unbiased [37]. Reliance on an algorithm to predict health-related outcomes or to make decisions about care would increase the pace of decision-making, but the point at which the decision should be transferred from machine to human is necessary, unclear, and currently unregulated [37].


Large amounts of data are available for analysis, and the demands on the health care industry are increasing, making the use of predictive modeling to aid hospital operations sensible and increasingly necessary. The old adage “garbage in garbage out” remains true when applied to predictive models—models developed without quality methodologies risk producing predictions deficient of quality. A model that produces biased predictions may not resolve the problem at hand. Evidence that a model is effective and safe is necessary before its use in a clinical setting. Best practices promoting standards for development and operation will have a role to play in model improvement and their use in clinical settings.

Application of models that predict hospital admission could aid hospital bed managers to secure an appropriate bed for a patient in a timely manner while boosting hospital efficiency and with no harm to patients. The result of this timely and streamlined systems process is better patient care delivered sooner.

We posit that applying a systems approach using prediction models to the hospital bed management strategy for ED patients would reveal the many parts and subsystems involved before and after bed assignment and would ensure that they are part of the solution. This unique application of a prediction model provides bed managers information to support initiation of bed management processes earlier in the care continuum. This strategic use of information has significant potential to reduce hospital exit block and ED boarding, and subsequently ED crowding [12].

Conflicts of Interest

None declared.

  1. Sinclair D. Emergency department overcrowding - implications for paediatric emergency medicine. Paediatr Child Health. Jul 2007;12(6):491-494. [FREE Full text] [CrossRef] [Medline]
  2. American College of Emergency Physicians. Crowding. Ann Emerg Med. Jun 2006;47(6):585. [CrossRef] [Medline]
  3. Richards JR, van der Linden MC, Derlet RW. Providing care in emergency department hallways: demands, dangers, and deaths. Adv J Emerg Med. 2014 [FREE Full text] [CrossRef]
  4. Henderson K, Boyle A. Exit block in the emergency department: recognition and consequences. Br J Hosp Med (Lond). Nov 02, 2014;75(11):623-626. [FREE Full text] [CrossRef] [Medline]
  5. Young C. Hospital Emergency Departments: Crowding Continues to Occur, and Some Patients Wait Longer than Recommended Time Frames. U.S. Government Accountability Office. 2009. URL: https://www.gao.gov/products/gao-09-347 [accessed 2023-06-16]
  6. Institute of Medicine. Hospital-Based Emergency Care: At the Breaking Point. Washington, DC. The National Academies Press; 2007.
  7. Higginson I. Emergency department crowding. Emerg Med J. Jun 04, 2012;29(6):437-443. [CrossRef] [Medline]
  8. Mason S, Knowles E, Boyle A. Exit block in emergency departments: a rapid evidence review. Emerg Med J. Jan 27, 2017;34(1):46-51. [FREE Full text] [CrossRef] [Medline]
  9. Barrett L, Ford S, Ward-Smith P. A bed management strategy for overcrowding in the emergency department. Nurs Econ. 2012;30(2):82-5, 116. [Medline]
  10. Amarasingham R, Swanson TS, Treichler DB, Amarasingham SN, Reed WG. A rapid admission protocol to reduce emergency department boarding times. Qual Saf Health Care. Jun 2010;19(3):200-204. [CrossRef] [Medline]
  11. Process approach. Professional Evaluation and Certification Board. Mar 21, 2016. URL: https://pecb.com/article/process-approach [accessed 2022-03-21]
  12. Monahan AC, Feldman SS, Fitzgerald TP. Reducing crowding in emergency departments with early prediction of hospital admission of adult patients using biomarkers collected at triage: retrospective cohort study. JMIR Bioinform Biotech. Sep 13, 2022;3(1):e38845. [CrossRef]
  13. Austin E, Blakely B, Salmon P, Braithwaite J, Clay-Williams R. Technology in the emergency department: using cognitive work analysis to model and design sustainable systems. Safety Science. Mar 2022;147:105613. [FREE Full text] [CrossRef]
  14. Stead LG, Jain A, Decker WW. Emergency department over-crowding: a global perspective. Int J Emerg Med. Sep 30, 2009;2(3):133-134. [FREE Full text] [CrossRef] [Medline]
  15. Kauppila T, Seppänen K, Mattila J, Kaartinen J. The effect on the patient flow in a local health care after implementing reverse triage in a primary care emergency department: a longitudinal follow-up study. Scand J Prim Health Care. Jun 08, 2017;35(2):214-220. [FREE Full text] [CrossRef] [Medline]
  16. Hospital Compare - User Guide. URL: https://health.mo.gov/data/hai/pdf/hospital-compare-user-guide.pdf [accessed 2023-06-16]
  17. Improving Patient Flow and Reducing Emergency Department Crowding: A Guide for Hospitals. Agency for Healthcare Research and Quality. URL: https://www.ahrq.gov/research/findings/final-reports/ptflow/index.html [accessed 2023-06-16]
  18. Institute of Medicine (US) Committee on Quality of Health Care in America. In: Kohn LT, Corrigan JM, Donaldson MS, editors. To Err is Human: Building a Safer Health System. Washington, DC. National Academies Press; 2000.
  19. Falvo T, Grove L, Stachura R, Vega D, Stike R, Schlenker M, et al. The opportunity loss of boarding admitted patients in the emergency department. Acad Emerg Med. Apr 2007;14(4):332-337. [FREE Full text] [CrossRef] [Medline]
  20. Brink A, Alsma J, Brink HS, de Gelder J, Lucke JA, Mooijaart SP, et al. Prediction admission in the older population in the Emergency Department: the CLEARED tool. Neth J Med. Dec 2020;78(6):357-367. [FREE Full text] [Medline]
  21. Marcusson J, Nord M, Dong H, Lyth J. Clinically useful prediction of hospital admissions in an older population. BMC Geriatr. Mar 06, 2020;20(1):95. [FREE Full text] [CrossRef] [Medline]
  22. Erkamp NS, van Dalen DH, de Vries E. Predicting emergency department visits in a large teaching hospital. Int J Emerg Med. Jun 12, 2021;14(1):34. [FREE Full text] [CrossRef] [Medline]
  23. Hoot NR, LeBlanc LJ, Jones I, Levin SR, Zhou C, Gadd CS, et al. Forecasting emergency department crowding: a prospective, real-time evaluation. J Am Med Inform Assoc. May 01, 2009;16(3):338-345. [CrossRef]
  24. Predictive Modeling. Gartner. URL: https://www.gartner.com/en/information-technology/glossary/predictive-modeling [accessed 2022-04-02]
  25. Steyerberg EW. Clinical Prediction Models A Practical Approach to Development, Validation, and Updating. New York, NY. Springer International Publishing; 2019.
  26. Moons KG, Wolff RF, Riley RD, Whiting PF, Westwood M, Collins GS, et al. PROBAST: a tool to assess risk of bias and applicability of prediction model studies: explanation and elaboration. Ann Intern Med. Jan 01, 2019;170(1):W1. [CrossRef]
  27. Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. Jan 2010;21(1):128-138. [FREE Full text] [CrossRef] [Medline]
  28. Monahan AC, Feldman SS. Models predicting hospital admission of adult patients utilizing prehospital data: systematic review using PROBAST and CHARMS. JMIR Med Inform. Sep 16, 2021;9(9):e30022. [FREE Full text] [CrossRef] [Medline]
  29. Howell E, Bessman E, Kravet S, Kolodner K, Marshall R, Wright S. Active bed management by hospitalists and emergency department throughput. Ann Intern Med. Dec 02, 2008;149(11):804-811. [CrossRef] [Medline]
  30. 2019 Predictive Analytics in Health Care Trend Forecast. Society for Actuaries. URL: https:/​/www.​soa.org/​globalassets/​assets/​Files/​programs/​predictive-analytics/​2019-health-care-trend.​pdf [accessed 2023-06-16]
  31. Steyerberg EW, Harrell FE. Prediction models need appropriate internal, internal-external, and external validation. J Clin Epidemiol. Jan 2016;69:245-247. [FREE Full text] [CrossRef] [Medline]
  32. McIntosh GS, Steenstra I, Hogg-Johnson S, Carter T, Hall H. Lack of prognostic model validation in low back pain prediction studies: a systematic review. Clin J Pain. Aug 2018;34(8):748-754. [CrossRef] [Medline]
  33. Shamsoddin E. Can medical practitioners rely on prediction models for COVID-19? A systematic review. Evid Based Dent. Sep 25, 2020;21(3):84-86. [FREE Full text] [CrossRef] [Medline]
  34. Miles J, Turner J, Jacques R, Williams J, Mason S. Using machine-learning risk prediction models to triage the acuity of undifferentiated patients entering the emergency care system: a systematic review. Diagn Progn Res. Oct 02, 2020;4(1):16. [FREE Full text] [CrossRef] [Medline]
  35. Kareemi H, Vaillancourt C, Rosenberg H, Fournier K, Yadav K. Machine learning versus usual care for diagnostic and prognostic prediction in the emergency department: a systematic review. Acad Emerg Med. Feb 02, 2021;28(2):184-196. [FREE Full text] [CrossRef] [Medline]
  36. Wynants L, Van Calster B, Collins GS, Riley RD, Heinze G, Schuit E, et al. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ. Apr 07, 2020;369:m1328. [FREE Full text] [CrossRef] [Medline]
  37. Watson K. Predictive analytics in health caremerging value and risks. Deloitte Insights 2021 March 12, 2022. 2019. URL: https:/​/www2.​deloitte.com/​us/​en/​insights/​topics/​analytics/​predictive-analytics-health-care-value-risks.​html [accessed 2022-03-12]


ED: emergency department


Edited by T Leung; submitted 29.08.22; peer-reviewed by J Jewer, S Nagavally, G Kolostoumpis; comments to author 25.11.22; revised version received 12.01.23; accepted 10.05.23; published 10.07.23.

Copyright

©Ann Corneille Monahan, Sue S Feldman. Originally published in the Interactive Journal of Medical Research (https://www.i-jmr.org/), 10.07.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Interactive Journal of Medical Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.i-jmr.org/, as well as this copyright and license information must be included.