Using patient experience data to develop a patient experience toolkit to improve hospital care: a mixed-methods study

Project report


Sheard, L., Marsh, C., Mills, T., Peacock, R., Langley, J., Partridge, R., Gwilt, I. and Lawton, R. (2019). Using patient experience data to develop a patient experience toolkit to improve hospital care: a mixed-methods study. NIHR, Health Services and Delivery Research . https://doi.org/10.3310/hsdr07360
AuthorsSheard, L., Marsh, C., Mills, T., Peacock, R., Langley, J., Partridge, R., Gwilt, I. and Lawton, R.
TypeProject report
Abstract

Background
Patients are increasingly being asked to provide feedback about their experience of health-care services. Within the NHS, a significant level of resource is now allocated to the collection of this feedback. However, it is not well understood whether or not, or how, health-care staff are able to use these data to make improvements to future care delivery.

Objective
To understand and enhance how hospital staff learn from and act on patient experience (PE) feedback in order to co-design, test, refine and evaluate a Patient Experience Toolkit (PET).

Design
A predominantly qualitative study with four interlinking work packages.

Setting
Three NHS trusts in the north of England, focusing on six ward-based clinical teams (two at each trust).

Methods
A scoping review and qualitative exploratory study were conducted between November 2015 and August 2016. The findings of this work fed into a participatory co-design process with ward staff and patient representatives, which led to the production of the PET. This was primarily based on activities undertaken in three workshops (over the winter of 2016/17). Then, the facilitated use of the PET took place across the six wards over a 12-month period (February 2017 to February 2018). This involved testing and refinement through an action research (AR) methodology. A large, mixed-methods, independent process evaluation was conducted over the same 12-month period.

Findings
The testing and refinement of the PET during the AR phase, with the mixed-methods evaluation running alongside it, produced noteworthy findings. The idea that current PE data can be effectively triangulated for the purpose of improvement is largely a fallacy. Rather, additional but more relational feedback had to be collected by patient representatives, an unanticipated element of the study, to provide health-care staff with data that they could work with more easily. Multidisciplinary involvement in PE initiatives is difficult to establish unless teams already work in this way. Regardless, there is merit in involving different levels of the nursing hierarchy. Consideration of patient feedback by health-care staff can be an emotive process that may be difficult initially and that needs dedicated time and sensitive management. The six ward teams engaged variably with the AR process over a 12-month period. Some teams implemented far-reaching plans, whereas other teams focused on time-minimising ‘quick wins’. The evaluation found that facilitation of the toolkit was central to its implementation. The most important factors here were the development of relationships between people and the facilitator’s ability to navigate organisational complexity.

Limitations
The settings in which the PET was tested were extremely diverse, so the influence of variable context limits hard conclusions about its success.

Conclusions
The current manner in which PE feedback is collected and used is generally not fit for the purpose of enabling health-care staff to make meaningful local improvements. The PET was co-designed with health-care staff and patient representatives but it requires skilled facilitation to achieve successful outcomes.

Funding
The National Institute for Health Research Health Services and Delivery Research programme.

Year2019
PublisherNIHR, Health Services and Delivery Research
Digital Object Identifier (DOI)https://doi.org/10.3310/hsdr07360
Web address (URL)https://www.journalslibrary.nihr.ac.uk/hsdr/hsdr07360/#/abstract
File
License
File Access Level
Open
Publication dates
Print01 Oct 2019
Publication process dates
Deposited31 Aug 2022
Permalink -

https://openresearch.lsbu.ac.uk/item/91v7x

Download files


File
3030804.pdf
License: CC BY 4.0
File access level: Open

  • 16
    total views
  • 3
    total downloads
  • 0
    views this month
  • 0
    downloads this month

Export as

Related outputs

Development of a ‘real-world’ logic model through testing the feasibility of a complex healthcare intervention: the challenge of reconciling scalability and context-sensitivity
Mills, T., Shannon, R., O'Hara, J., Lawton, R. and Sheard, L. Development of a ‘real-world’ logic model through testing the feasibility of a complex healthcare intervention: the challenge of reconciling scalability and context-sensitivity. Evaluation. https://doi.org/10.1177/13563890211068869
Improving patient experience and safety at transitions of care through the Your Care Needs You (YCNY) intervention: a study protocol for a cluster randomised controlled feasibility trial
Baxter, R., Murray, J., O'Hara, J., Hewitt, C., Richardson, G., Cockayne, S., Sheard, L., Mills, T. and Lawton, R. (2022). Improving patient experience and safety at transitions of care through the Your Care Needs You (YCNY) intervention: a study protocol for a cluster randomised controlled feasibility trial. Pilot and Feasibility Studies. 6 (123). https://doi.org/10.1186/s40814-020-00655-5
Improving the safety and experience of transitions from hospital to home: a cluster randomised controlled feasibility trial of the ’Your Care Needs You’ intervention versus usual care
Baxter, R., Murray, J., Cockayne, S., Baird, K., Mandefield, L., Mills, T., Lawton, R., Hewitt, C., Richardson, G., Sheard, L. and O.Hara, J. (2022). Improving the safety and experience of transitions from hospital to home: a cluster randomised controlled feasibility trial of the ’Your Care Needs You’ intervention versus usual care. Pilot and Feasibility Studies. 8 (222). https://doi.org/10.1186/s40814-022-01180-3
A qualitative formative evaluation of a patient facing intervention to improve care transitions for older people moving from hospital to home
Shannon, R., Baxter, R., Hardicre, N., Mills, T., Murray, J., Lawton, R. and O'Hara, J. (2022). A qualitative formative evaluation of a patient facing intervention to improve care transitions for older people moving from hospital to home. Health Expectations. https://doi.org/10.1111/hex.13560
Integration of a clinical pharmacist workforce into newly forming primary care networks: a qualitatively driven, complex systems analysis
Mills, T., Madden, M., Stewart, D., Gough, B. and McCambridge, J. (2022). Integration of a clinical pharmacist workforce into newly forming primary care networks: a qualitatively driven, complex systems analysis. BMJ Open. 12 (11). https://doi.org/10.1136/bmjopen-2022-066025
Early implementation of the structured medication review in England: a qualitative study.
Madden, M., Mills, T., Atkin, K., Stewart, D. and McCambridge, J. (2022). Early implementation of the structured medication review in England: a qualitative study. The British journal of general practice : the journal of the Royal College of General Practitioners. https://doi.org/BJGP.2022.0014
Multiple meanings of resilience: Health professionals' experiences of a dual element training intervention designed to help them prepare for coping with error
Janes, G., Harrison, R., Johnson, J., Simms-Ellis, R., Mills, T. and Lawton, R. (2021). Multiple meanings of resilience: Health professionals' experiences of a dual element training intervention designed to help them prepare for coping with error. Journal of Evaluation in Clinical Practice. 28. https://doi.org/10.1111/jep.13555
Using qualitative process evaluation in the development of a complex intervention to advance person-centred practice by pharmacists: The Medicines and Alcohol Consultation (MAC)
Madden, M., Morris, S., Stewart, D., Atkin, K., Gough, B., Mills, T. and McCambridge, J. (2021). Using qualitative process evaluation in the development of a complex intervention to advance person-centred practice by pharmacists: The Medicines and Alcohol Consultation (MAC). Social Science and Medicine - Qualitative Research in Health. 1. https://doi.org/10.1016/j.ssmqr.2021.100012
The Association Between Health Care Staff Engagement and Patient Safety Outcomes: A Systematic Review and Meta-Analysis
Janes, G., Mills, T., Budworth, L., Johnson, J. and Lawton, R. (2021). The Association Between Health Care Staff Engagement and Patient Safety Outcomes: A Systematic Review and Meta-Analysis. Journal of Patient Safety. 17 (3), pp. 207-216. https://doi.org/10.1097/PTS.0000000000000807
Can we prepare healthcare professionals and students for involvement in stressful healthcare events? A mixed-methods evaluation of a resilience training intervention
Johnson, J., Simms-Ellis, R., Janes, G., Mills, T., Budworth, L., Atkinson, L. and Reema, H. (2020). Can we prepare healthcare professionals and students for involvement in stressful healthcare events? A mixed-methods evaluation of a resilience training intervention. BMC Health Services Research. 20. https://doi.org/10.1186/s12913-020-05948-2
Improving transitions from hospital to home: Using ‘real world’ logic models to derive learning from a feasibility trial of a ‘hybrid intervention’
Mills, T., Baxter, R., Shannon, R., Murray, J., Lawton, R. and O'Hara, J. (2020). Improving transitions from hospital to home: Using ‘real world’ logic models to derive learning from a feasibility trial of a ‘hybrid intervention’. Health Services Research UK.
Between interventions and systems: A proposal for ‘real world’ logic models
Mills, T. (2019). Between interventions and systems: A proposal for ‘real world’ logic models. Improving Patient Safety Conference. Oct 2019
Developing, implementing and evaluating the Yorkshire Patient Experience Toolkit (PET): How process evaluation can strengthen action research
Mills, T., Lawton, R. and Sheard, L. (2019). Developing, implementing and evaluating the Yorkshire Patient Experience Toolkit (PET): How process evaluation can strengthen action research. Health Services Research UK.
Dialectical thinking and the 'economic determinants' of performance: What Marxism can contribute to health services research in an age of complexity
Mills, T. (2019). Dialectical thinking and the 'economic determinants' of performance: What Marxism can contribute to health services research in an age of complexity. British Sociological Association: Medical Sociology.
National Patient Safety Alerts: An Exploration of How Trusts Coordinate their Responses
Mills, T., Atkinson, L., Janes, G. and Lawton, R. (2019). National Patient Safety Alerts: An Exploration of How Trusts Coordinate their Responses. NHS.
Steering, Knowledge and the Challenge of Governance Evaluation: The Case of National Health Service Governance and Reform in England
Greenwood, D and Mills, T. (2019). Steering, Knowledge and the Challenge of Governance Evaluation: The Case of National Health Service Governance and Reform in England. Administration and Society. 52 (7). https://doi.org/10.1177/0095399719883564
Improving Patient Experience in Hospital Settings: Assessing the Role of Toolkits and Action Research through a Process Evaluation of a Complex Intervention
Mills, T., Lawton, R. and Sheard, L. (2019). Improving Patient Experience in Hospital Settings: Assessing the Role of Toolkits and Action Research through a Process Evaluation of a Complex Intervention. Qualitative Health Research. 29 (14), pp. 2108 - 2118. https://doi.org/10.1177/1049732319855960
Advancing Complexity Theory in Health Services Research: The Logic of Logic Models
Mills, T., Lawton, R. and Sheard, L. (2019). Advancing Complexity Theory in Health Services Research: The Logic of Logic Models. BMC Medical Research Methodology. 19 (55). https://doi.org/10.1186/s12874-019-0701-4
Advancing Complexity Science in Healthcare Research: The Logic of Logic Models
Mills, T., Lawton, R. and Sheard, L. (2018). Advancing Complexity Science in Healthcare Research: The Logic of Logic Models. Health Services Research UK.
Exploring the Economic Dimensions of Complexity: A Post-Positivist Evaluation of Diabetes Policy and Governance
Mills, T. (2017). Exploring the Economic Dimensions of Complexity: A Post-Positivist Evaluation of Diabetes Policy and Governance. "We Need to Talk About Complexity": Oxford University Talks. Green Templeton College, University of Oxford 13 - 14 Jun 2017
Losing Control Again? Power and the quality of working life
Mills, T. and Overell, S. (2010). Losing Control Again? Power and the quality of working life. The Work Foundation.