Section 11: De-Implementation in Pragmatic Research

11.1 Choosing What to De-implement

[NOTE: CONTENT FROM NORTON (2022) AND DOSSETT (2022), NEED PERMISSION IF USING]

De-implementing ineffective interventions in health care and public health settings is essential for minimizing patient harm, maximizing efficient use of resources, maintaining public trust, and improving population health. Research has documented the use of ineffective or low-value health-focused practices across a range of health content areas, giving rise to the increasing recognition and need for research on de-implementing such interventions to ultimately guide de-implementation practice.

Choosing Wisely and similar campaigns have provided over 550 recommendations to avoid the use of tests and treatments that do not benefit patients. For those interested in reducing low-value care, how to choose which of these recommendations to support with active de-implementation efforts can be difficult. Implementation scientists must review evidence in favor of de-implementation, evaluate current practice, and consider the views of stakeholders and other practical contextual factors that support or hinder de-implementation efforts.

  1. Consider the Evidence (adapted from the Tailored Implementation for Chronic Disease (TICD) Checklist)
    Deciding what to de-implement requires an evaluation of the evidence base supporting de-implementation. Recommendations supported by randomized controlled trials and/or meta-analyses are excellent targets for de-implementation. Consider these questions:
    -What is the quality of the evidence supporting the recommendation and has it been assessed appropriately?
    -Is the recommended action (what to avoid or not do) stated specifically and unambiguously? Is sufficient detail provided to allow the targeted healthcare professional to perform the recommended action?
    -Do the organizations who made the recommendation have credibility with the targeted healthcare professionals?
    -Is the recommendation consistent with other guidelines?
  2. Evaluate Current Practice
    Deciding what to de-implement requires an evaluation of current practice as compared to the ideal practice or evidence. Some low-value practices may be infrequently performed due to natural de-implementation while others may be frequently performed and deeply entrenched. Formal de-implementation efforts should be focused on low-value practices that are common or harmful.
  3. Consider Stakeholders
    Deciding what to de-implement requires consideration of the relative strength of opinions and stakeholders. De-implementation efforts targeting low-value practices without strong detractors (i.e., unnecessary routine labs or imaging) are more likely to be successful as compared to those practices where stakeholders may hold strongly held beliefs or differing views of value (i.e., contralateral prophylactic mastectomy in patients with breast cancer).
  • Berlin NL, Skolarus TA, Kerr EA, Dossett LA. Too Much Surgery: Overcoming Barriers to Deimplementation of Low-value Surgery. Ann Surg. 2020;271(6):1020-1022. doi:10.1097/SLA.0000000000003792
  • Wang T, Sabel MS, Dossett LA. A Framework for De-implementation in Surgery. Ann Surg. 2021;273(3):e105-e107. doi:10.1097/SLA.0000000000004325
  • Baskin AS, Wang T, Berlin NL, Skolarus TA, Dossett LA. Scope and Characteristics of Choosing Wisely in Cancer Care Recommendations by Professional Societies. JAMA Oncol. 2020;6(9):1463-1465. doi:10.1001/jamaoncol.2020.2066
  • Wang T, Baskin AS, Dossett LA. Deimplementation of the Choosing Wisely Recommendations for Low-Value Breast Cancer Surgery: A Systematic Review. JAMA Surg. 2020;155(8):759-770. doi:10.1001/jamasurg.2020.0322

Advancing De-implementation Research in Health Care and Public Health: Current Approaches and Future Directions

Choosing What to De-Implement: Examples from Clinical Practice

11.5 De-implementation Outcomes and Equity Considerations

[CONTENT NOTE: THIS IS FROM HELFRICH (2022), PERMISSION NEEDED TO USE]

There are several considerations for assessing outcomes when studying de-implementation or developing de-implementation programs.

Unintended consequences. Psychological reactance (anger & mistrust): both patients and providers could potentially experience de-implementation efforts as an infringement, for patients on their right to receive services, and for providers on their professional autonomy.

Intervention-outcome asymmetry. In implementation efforts, the intervention outcome is the benefit from implementing the evidence-based practice; at least in principle, the clinician or practitioner who is implementing the evidence-based practice is delivering some benefit to their patient. However, for de-implementation efforts, the expected benefit is typically an absence of bad outcomes – from the provider’s or practitioner’s perspective, the best expected outcome is often literally nothing: a low-value inhaler is eliminated and the patient doesn’t experience a breathing exacerbation; a low-value cancer screening is forgone and the patient never develops cancers; a patient who has an upper respiratory infection doesn’t receive an antibiotic and it resolves on its own in a couple of weeks. The problem this creates for the provider or practitioner is that they may experience a real risk of a bad outcome, e.g., an angry patient or a random bad event, and conversely fail to perceive any real benefit. More so than implementation interventions, de-implementation may require implementation researchers to engineer feedback that helps reveal the benefits to stakeholders and create positive reinforcement for de-implementation.

Outcome measurement. Proctor and colleagues established a set of outcomes specific to implementation, meaning factors that implementation strategies could or need to influence in order to achieve high levels of implementation. These include acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration, and sustainability. These can be equally applied to much de-implementation work, but in some cases, e.g., certain tests and imaging, patient and provider (or other stakeholder) perceptions of the low-value practice are difficult to assess and even potentially introduce confusion.

Equity challenges. Within insured populations (e.g., a given managed care organization, or within Medicare), we can end up in a situation
where some patients subsidize low-value care delivered to other patients. This is because all patients pay into insurance, but receipt of low-value care can vary substantially among patients. There is some research that finds more socially or economically advantaged patients are more likely to receive low-value care, while other research suggests that socioeconomically-disadvantaged patients are subject to both more low-value care & less high-value care, or that these populations may receive less care overall – less high-value care but also less low-value care. There are also documented differences among patients by race and gender in their relative concerns about overuse and under-use, which have profound implications for how patients respond to de-implementation efforts.

  • Helfrich C, Majerczyk B, Nolen E. De-Implementing Low-Value Practices in Healthcare and Public Health. In: Weiner B, Lewis C, Sherr K, eds. Practical Implementation Science: Moving Evidence into Action. Springer Publishing; 2022.
  • Helfrich CD, Hartmann CW, Parikh TJ, Au DH. Promoting Health Equity through De-Implementation Research. Ethn Dis. 2019;29(Suppl 1):93-96. Published 2019 Feb 21. doi:10.18865/ed.29.S1.93
  • Groeneveld PW, Kwoh CK, Mor MK, et al. Racial differences in expectations of joint replacement surgery outcomes. Arthritis Rheum. 2008;59(5):730-737. doi:10.1002/art.23565
  • Kressin NR, Groeneveld PW. Race/Ethnicity and overuse of care: a systematic review. Milbank Q. 2015;93(1):112-138. doi:10.1111/1468-0009.12107
  • Kressin NR, Lin MY. Race/ethnicity, and Americans’ perceptions and experiences of over- and under-use of care: a cross-sectional study. BMC Health Serv Res. 2015;15:443. Published 2015 Oct 1. doi:10.1186/s12913-015-1106-7
  • Proctor E, Silmere H, Raghavan R, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65-76. doi:10.1007/s10488-010-0319-7
  • Schpero WL, Morden NE, Sequist TD, Rosenthal MB, Gottlieb DJ, Colla CH. For Selected Services, Blacks And Hispanics More Likely To Receive Low-Value Care Than Whites. Health Aff (Millwood). 2017;36(6):1065-1069. doi:10.1377/hlthaff.2016.1416
  • Xu WY, Jung JK. Socioeconomic Differences in Use of Low-Value Cancer Screenings and Distributional Effects in Medicare. Health Serv Res. 2017;52(5):1772-1793. doi:10.1111/1475-6773.12559