Section 4: Selecting Theories, Models and Frameworks

4.1 Introduction

needs content

4.2 Choosing a Framework

Identify one or more frameworks that reflect levels of change and contextual or setting characteristics relevant to your research. Some commonly-used pragmatic research frameworks are summarized below.

You may also consider creating a logic model to guide the selection of models and frameworks for your project. For guidance on creating a logic model, visit the Plan section of the D&I webtool.

  • Moullin, J.C., Dickson, K.S., Stadnick, N.A. et al. Ten recommendations for using implementation frameworks in research and practice. Implement Sci Commun 1, 42 (2020). https://doi.org/10.1186/s43058-020-00023-7
  • Smith JD, Li DH, Rafferty MR. The Implementation Research Logic Model: a method for planning, executing, reporting, and synthesizing implementation projects. Implement Sci. 2020;15(1):84. doi:10.1186/s13012-020-01041-8

Identifying Multilevel Contextual Factors

Assessing Multilevel Contexts

4.2.1

PRISM/RE-AIM

  • Glasgow RE, Harden SM, Gaglio B, et al. RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review. Front Public Health. 2019;7:64. Published 2019 Mar 29. doi:10.3389/fpubh.2019.00064
  • McCreight MS, Rabin BA, Glasgow RE, et al. Using the Practical, Robust Implementation and Sustainability Model (PRISM) to qualitatively assess multilevel contextual factors to help plan, implement, evaluate, and disseminate health services programs. Transl Behav Med. 2019;9(6):1002-1011. doi:10.1093/tbm/ibz085
  • Harden SM, Smith ML, Ory MG, Smith-Ray RL, Estabrooks PA, Glasgow RE. RE-AIM in Clinical, Community, and Corporate Settings: Perspectives, Strategies, and Recommendations to Enhance Public Health Impact. Front Public Health. 2018;6:71. Published 2018 Mar 22. doi:10.3389/fpubh.2018.00071

A Tour of Frameworks for Planning Pragmatic Research: PRISM/RE-AIM

4.2.2

The EPIS Framework

  • Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implement Sci. 2019;14(1):1. Published 2019 Jan 5. doi:10.1186/s13012-018-0842-6

A Tour of Frameworks for Planning Pragmatic Research: The EPIS Framework

4.2.3

The REP Framework

A Tour of Frameworks for Planning Pragmatic Research: The REP Framework

4.2.4

The Knowledge-to-Action Cycle

A Tour of Frameworks for Planning Pragmatic Research: The Knowledge-to-Action Cycle

4.2.5

The MOST Framework

  • Guastaferro K, Collins LM. Achieving the Goals of Translational Science in Public Health Intervention Research: The Multiphase Optimization Strategy (MOST). Am J Public Health. 2019;109(S2):S128-S129. doi:10.2105/AJPH.2018.304874
  • Collins, L. M. (2018). Optimization of behavioral, biobehavioral, and biomedical interventions: The multiphase optimization strategy (MOST). New York: Springer.

Using the Multiphase Optimization Strategy (MOST) for Developing, Optimizing, and Evaluating Multicomponent Interventions

4.2.6

Small P Policy Framework

A Tour of Frameworks for Planning Pragmatic Research: Small P Policy Framework

4.3 Frameworks for Complexity & Systems Science

Despite broad recognition of the need to account for complexity in pragmatic research, many available conceptual tools and frameworks are linear or categorical. Diagramming approaches from systems science such as causal-loop modeling and stock-and-flow diagramming can be used to visually describe how an intervention is believed to act on multilevel contextual factors to produce outcomes.

The talks and handouts linked in this section provide more detail about a variety of systems-science approaches that may be useful.

Apostolopoulos Y, Lich KH, Lemke MK, eds. Complex Systems and Population Health. 1st edition. Oxford University Press; 2020.

Sterman, J. Business Dynamics: Systems Thinking and Modeling for a Complex World. Irwin/McGraw Hill. (2000).

Ballard, E., Werner, K., & Priyadarshini, P. (2021). Boundary objects in translation: The role of language in participatory system dynamics modeling. System Dynamics Review, sdr.1694.

Ballard, E., Farrell, A., & Long, M. (2020). Community-Based System Dynamics for Mobilizing Communities to Advance School Health. Journal of School Health, 90(12), 964–975.

Langellier BA, Kuhlberg JA, Ballard EA, et al. Using community-based system dynamics modeling to understand the complex systems that influence health in cities: The SALURBAL study. Health Place. 2019;60:102215.

Hovmand, P. S. (2013). Community Based System Dynamics. Springer Business.

Király, G., & Miskolczi, P. (2019). Dynamics of participation: System dynamics and participation-An empirical review. Systems Research and Behavioral Science, 36(2), 199–210.

Meadows, D. (2008). Thinking in Systems: A Primer. Chelsea Green Publishing.

Vennix, J. A. M. (1999). Group model-building: Tackling messy problems. System Dynamics Review, 15(4), 23.

Richardson, G. P. (2011). Reflections on the foundations of system dynamics: Foundations of System Dynamics. System Dynamics Review, 27(3), 219–243.

Paina L, Peters DH. Understanding pathways for scaling up health services through the lens of complex adaptive systems. Health Policy Plan. 2012;27(5):365-373.

4.4 Pragmatic Research Frameworks – Key Questions

Questions to ask as you identify which pragmatic research framework(s) you will use to plan your study:

Assessing Multilevel Contexts

Identifying Multilevel Contextual Factors

4.4.1

How might my selected framework(s) guide the process of planning pragmatic research, adapting and refining interventions and study protocols, and establishing implementation, dissemination, and sustainability plans?

4.4.2

How might my selected framework(s) inform the outcomes and measures (including intermediate or process outcomes, mechanisms of change, or determinants/factors related to implementation) I want to study?

4.4.3

Do I need to combine frameworks? There are many occasions when selecting just one model will not address all your needs for guiding the planning, design, implementation, and evaluation activities. Nilsen classified D&I models into five broad categories based on their primary purpose: process models, determinant frameworks, classic theories, implementation frameworks, and evaluation frameworks. When one model does not suffice, you might decide to select multiple models and combine them.

4.4.4

Do I need to adapt a framework? There may not be a comprehensive model that will perfectly fit your study, so it may be necessary to further adapt the model or models you identified for your study.

Selecting, Adapting, Combining, and Using Frameworks for Pragmatic Research