Advancing Complexity Science in Healthcare Research: The Logic of Logic Models

Conference presentation


Mills, T., Lawton, R. and Sheard, L. (2018). Advancing Complexity Science in Healthcare Research: The Logic of Logic Models. Health Services Research UK.
AuthorsMills, T., Lawton, R. and Sheard, L.
TypeConference presentation
Abstract

Background

Logic models are commonly used in evaluations in healthcare research to represent how interventions produce outcomes in simple diagrammatical form. Uses of logic models include: serving as a framework in evaluations, forging consensus among stakeholders about a proposed change and knowledge transfer. However, whether logic models can be used for describing complex interventions which adapt to context remains unclear. This paper advances the field by proposing a more dynamic approach to logic modelling that focuses less on causal pathways from inputs to outcomes and more on contextual factors which shape causal pathways.

Methods

Various logic model types were tested as part of an evaluation of a Patient Experience (PE) Toolkit intervention, designed to guide healthcare professionals through a facilitated process of reflecting and acting on patient experience data. Implemented through action research across 6 diverse hospital wards, the PE Toolkit intervention was found to bear the hallmarks of a highly complex intervention. In particular, the facilitation provided by the action researchers was crucial to its functioning, allowing the intervention to take on different form in the different settings. An initial logic model, developed iteratively on the basis of a large qualitative dataset containing multiple data sources, was rejected at the halfway point of the study as it failed to capture intervention dynamics. Other logic models used in healthcare research were assessed as to whether they could account for the complexity of the intervention and a typology of logic model types, including strengths and weaknesses, was created. Implementation models were then explored and the PHARIS model was identified as being able to successfully model interaction between interventions, facilitation and context. The Venn-diagram used in the PHARIS model was incorporated into the logic model for the PE Toolkit intervention, after which a set of guiding principles for advancing the field was formulated.

Results

Three dominant types of logic model exist in healthcare research, each of which fail to capture the dynamics of complex interventions. These models may have potentially negative consequences, such as promoting the wrong courses of action in particular settings. However, a fourth type is possible that specifically models how contextual factors shape causal processes. These can be created by drawing upon theories and frameworks of implementation and context, using diverse shapes and arrows to highlight dynamic relationships and contingencies, specifying at what level “moderators” exert an effect and incorporating diverse stakeholder views.

Implications

Logic models can be used to represent how complex interventions work but more dynamic models are required than is currently the case in healthcare research. A potential implication of this is for logic models to take on a different role in improvement projects in future. That is, less of a role for logic models forging consensus among stakeholders or as precise guides for practitioners and more of a role stimulating discussion about how interventions work across different settings.

KeywordsLogic models, complexity science, context
Year2018
Accepted author manuscript
License
File Access Level
Open
Publication dates
Print05 Jul 2018
Publication process dates
Deposited05 Dec 2022
Web address (URL) of conference proceedingshttps://hsruk.org/sites/default/files/upload/HSRUK%20Conference%202018%20-%20Abstract%20Book_1.pdf
Permalink -

https://openresearch.lsbu.ac.uk/item/92vw0

Download files


Accepted author manuscript
Mills HSRUK 2018.pptx
License: CC BY 4.0
File access level: Open

  • 53
    total views
  • 10
    total downloads
  • 7
    views this month
  • 0
    downloads this month

Export as

Related outputs

Involving Lived Experience in regional efforts to address gambling-related harms: going beyond ‘window dressing’ and ‘tick box exercises’
Jenkins, C., Mills, T., Grimes J, Bland C, Reavey, P., Wills, J. and Sykes, S. (2024). Involving Lived Experience in regional efforts to address gambling-related harms: going beyond ‘window dressing’ and ‘tick box exercises’. BMC Public Health. 24, p. 384. https://doi.org/10.21203/rs.3.rs-3658745/v1
Evaluation of a city-region initiative to galvanise a community response to gambling-related harms
Jenkins, C and Mills, T (2023). Evaluation of a city-region initiative to galvanise a community response to gambling-related harms. European Journal of Public Health. 33 (Supplement_2). https://doi.org/10.1093/eurpub/ckad160.676
Harnessing lived experience in a community-based intervention to address gambling-related harms
Jenkins, C, Mills, T, Reavey, P, Moss, A, Sykes, S, Wills, J and Grimes, J (2023). Harnessing lived experience in a community-based intervention to address gambling-related harms. European Journal of Public Health. 33 (Supplement_2). https://doi.org/10.1093/eurpub/ckad160.1654
‘Odds Are: They Win’: a disruptive messaging innovation for challenging harmful products and practices of the gambling industry
T. Mills, J. Grimes, E. Caddick, C.L. Jenkins, J. Evans, A. Moss, J. Wills and S. Sykes (2023). ‘Odds Are: They Win’: a disruptive messaging innovation for challenging harmful products and practices of the gambling industry. Public Health. 224, pp. 41-44. https://doi.org/10.1016/j.puhe.2023.08.009
Consultation skills development in general practice: findings from a qualitative study of newly recruited and more experienced clinical pharmacists during the COVID-19 pandemic.
Madden, M., Stewart, D., Mills, T. and McCambridge, J. (2023). Consultation skills development in general practice: findings from a qualitative study of newly recruited and more experienced clinical pharmacists during the COVID-19 pandemic. BMJ Open. 13 (4), p. e069017. https://doi.org/10.1136/bmjopen-2022-069017
Alcohol, the overlooked drug: clinical pharmacist perspectives on addressing alcohol in primary care.
Madden, M., Stewart, D., Mills, T. and McCambridge, J. (2023). Alcohol, the overlooked drug: clinical pharmacist perspectives on addressing alcohol in primary care. Addiction science & clinical practice. 18 (1), p. 22. https://doi.org/10.1186/s13722-023-00378-x
Development of a ‘real-world’ logic model through testing the feasibility of a complex healthcare intervention: the challenge of reconciling scalability and context-sensitivity
Mills, T., Shannon, R., O'Hara, J., Lawton, R. and Sheard, L. Development of a ‘real-world’ logic model through testing the feasibility of a complex healthcare intervention: the challenge of reconciling scalability and context-sensitivity. Evaluation. https://doi.org/10.1177/13563890211068869
Improving patient experience and safety at transitions of care through the Your Care Needs You (YCNY) intervention: a study protocol for a cluster randomised controlled feasibility trial
Baxter, R., Murray, J., O'Hara, J., Hewitt, C., Richardson, G., Cockayne, S., Sheard, L., Mills, T. and Lawton, R. (2022). Improving patient experience and safety at transitions of care through the Your Care Needs You (YCNY) intervention: a study protocol for a cluster randomised controlled feasibility trial. Pilot and Feasibility Studies. 6 (123). https://doi.org/10.1186/s40814-020-00655-5
Improving the safety and experience of transitions from hospital to home: a cluster randomised controlled feasibility trial of the ’Your Care Needs You’ intervention versus usual care
Baxter, R., Murray, J., Cockayne, S., Baird, K., Mandefield, L., Mills, T., Lawton, R., Hewitt, C., Richardson, G., Sheard, L. and O.Hara, J. (2022). Improving the safety and experience of transitions from hospital to home: a cluster randomised controlled feasibility trial of the ’Your Care Needs You’ intervention versus usual care. Pilot and Feasibility Studies. 8 (222). https://doi.org/10.1186/s40814-022-01180-3
A qualitative formative evaluation of a patient facing intervention to improve care transitions for older people moving from hospital to home
Shannon, R., Baxter, R., Hardicre, N., Mills, T., Murray, J., Lawton, R. and O'Hara, J. (2022). A qualitative formative evaluation of a patient facing intervention to improve care transitions for older people moving from hospital to home. Health Expectations. https://doi.org/10.1111/hex.13560
Integration of a clinical pharmacist workforce into newly forming primary care networks: a qualitatively driven, complex systems analysis
Mills, T., Madden, M., Stewart, D., Gough, B. and McCambridge, J. (2022). Integration of a clinical pharmacist workforce into newly forming primary care networks: a qualitatively driven, complex systems analysis. BMJ Open. 12 (11). https://doi.org/10.1136/bmjopen-2022-066025
Early implementation of the structured medication review in England: a qualitative study.
Madden, M., Mills, T., Atkin, K., Stewart, D. and McCambridge, J. (2022). Early implementation of the structured medication review in England: a qualitative study. The British journal of general practice : the journal of the Royal College of General Practitioners. https://doi.org/BJGP.2022.0014
Multiple meanings of resilience: Health professionals' experiences of a dual element training intervention designed to help them prepare for coping with error
Janes, G., Harrison, R., Johnson, J., Simms-Ellis, R., Mills, T. and Lawton, R. (2021). Multiple meanings of resilience: Health professionals' experiences of a dual element training intervention designed to help them prepare for coping with error. Journal of Evaluation in Clinical Practice. 28. https://doi.org/10.1111/jep.13555
Using qualitative process evaluation in the development of a complex intervention to advance person-centred practice by pharmacists: The Medicines and Alcohol Consultation (MAC)
Madden, M., Morris, S., Stewart, D., Atkin, K., Gough, B., Mills, T. and McCambridge, J. (2021). Using qualitative process evaluation in the development of a complex intervention to advance person-centred practice by pharmacists: The Medicines and Alcohol Consultation (MAC). Social Science and Medicine - Qualitative Research in Health. 1. https://doi.org/10.1016/j.ssmqr.2021.100012
The Association Between Health Care Staff Engagement and Patient Safety Outcomes: A Systematic Review and Meta-Analysis
Janes, G., Mills, T., Budworth, L., Johnson, J. and Lawton, R. (2021). The Association Between Health Care Staff Engagement and Patient Safety Outcomes: A Systematic Review and Meta-Analysis. Journal of Patient Safety. 17 (3), pp. 207-216. https://doi.org/10.1097/PTS.0000000000000807
Can we prepare healthcare professionals and students for involvement in stressful healthcare events? A mixed-methods evaluation of a resilience training intervention
Johnson, J., Simms-Ellis, R., Janes, G., Mills, T., Budworth, L., Atkinson, L. and Reema, H. (2020). Can we prepare healthcare professionals and students for involvement in stressful healthcare events? A mixed-methods evaluation of a resilience training intervention. BMC Health Services Research. 20. https://doi.org/10.1186/s12913-020-05948-2
Improving transitions from hospital to home: Using ‘real world’ logic models to derive learning from a feasibility trial of a ‘hybrid intervention’
Mills, T., Baxter, R., Shannon, R., Murray, J., Lawton, R. and O'Hara, J. (2020). Improving transitions from hospital to home: Using ‘real world’ logic models to derive learning from a feasibility trial of a ‘hybrid intervention’. Health Services Research UK.
Between interventions and systems: A proposal for ‘real world’ logic models
Mills, T. (2019). Between interventions and systems: A proposal for ‘real world’ logic models. Improving Patient Safety Conference. Oct 2019
Developing, implementing and evaluating the Yorkshire Patient Experience Toolkit (PET): How process evaluation can strengthen action research
Mills, T., Lawton, R. and Sheard, L. (2019). Developing, implementing and evaluating the Yorkshire Patient Experience Toolkit (PET): How process evaluation can strengthen action research. Health Services Research UK.
Dialectical thinking and the 'economic determinants' of performance: What Marxism can contribute to health services research in an age of complexity
Mills, T. (2019). Dialectical thinking and the 'economic determinants' of performance: What Marxism can contribute to health services research in an age of complexity. British Sociological Association: Medical Sociology.
National Patient Safety Alerts: An Exploration of How Trusts Coordinate their Responses
Mills, T., Atkinson, L., Janes, G. and Lawton, R. (2019). National Patient Safety Alerts: An Exploration of How Trusts Coordinate their Responses. NHS.
Using patient experience data to develop a patient experience toolkit to improve hospital care: a mixed-methods study
Sheard, L., Marsh, C., Mills, T., Peacock, R., Langley, J., Partridge, R., Gwilt, I. and Lawton, R. (2019). Using patient experience data to develop a patient experience toolkit to improve hospital care: a mixed-methods study. NIHR, Health Services and Delivery Research . https://doi.org/10.3310/hsdr07360
Steering, Knowledge and the Challenge of Governance Evaluation: The Case of National Health Service Governance and Reform in England
Greenwood, D and Mills, T. (2019). Steering, Knowledge and the Challenge of Governance Evaluation: The Case of National Health Service Governance and Reform in England. Administration and Society. 52 (7). https://doi.org/10.1177/0095399719883564
Improving Patient Experience in Hospital Settings: Assessing the Role of Toolkits and Action Research through a Process Evaluation of a Complex Intervention
Mills, T., Lawton, R. and Sheard, L. (2019). Improving Patient Experience in Hospital Settings: Assessing the Role of Toolkits and Action Research through a Process Evaluation of a Complex Intervention. Qualitative Health Research. 29 (14), pp. 2108 - 2118. https://doi.org/10.1177/1049732319855960
Advancing Complexity Theory in Health Services Research: The Logic of Logic Models
Mills, T., Lawton, R. and Sheard, L. (2019). Advancing Complexity Theory in Health Services Research: The Logic of Logic Models. BMC Medical Research Methodology. 19 (55). https://doi.org/10.1186/s12874-019-0701-4
Exploring the Economic Dimensions of Complexity: A Post-Positivist Evaluation of Diabetes Policy and Governance
Mills, T. (2017). Exploring the Economic Dimensions of Complexity: A Post-Positivist Evaluation of Diabetes Policy and Governance. "We Need to Talk About Complexity": Oxford University Talks. Green Templeton College, University of Oxford 13 - 14 Jun 2017
Losing Control Again? Power and the quality of working life
Mills, T. and Overell, S. (2010). Losing Control Again? Power and the quality of working life. The Work Foundation.