Monitoring the quality of healthcare in England
The Health Foundation · Charity
In term In term in the September 2026 edition: the latest version runs to 12 August 2027.
- Reference
- DARS-NIC-276970-B8Y4H
- Current version
- v4.3
- Term of current version
- 13 August 2026 to 12 August 2027
- Start date
- 30 August 2019
- Data controller
- Sole Data Controller
- Commercial purposes
- No
- Sublicensing
- No
- Files released to date
- 222
Why the data was released
Objective for processing
The Health Foundation is an independent charity working to improve health and the quality of healthcare in the United Kingdom. As part of this strategy, the Health Foundation Research and Analysis team analyses data on the quality of health and care.
The Health Foundation is the data controller and also processes the data for this study.
The Research and Analysis team requires access to person-level data for an in-house programme of analyses to be completed over the course of the next 5 years.
The aim of this programme is to:
• produce new insights into quality of patient care,
• investigate how the quality of care can be improved
• understand the demand for health care in the UK using linked HES data and innovative analytical methods.
The overall purpose and benefit of this work is to inform the NHS and policy makers about changes in the characteristics and health needs of patients, factors that drive health care utilisation and health outcomes, and variation in health need, and quality of care. The work of The Health Foundation is designed to help the NHS understand the rising demand for health care and to plan for the future. The work packages within this programme will cover a number of thematic areas. These were identified as priorities for care quality and outcomes improvement in the recently published NHS Long Term Plan.
The Health Foundation are processing the data in line with their charitable goals as part of their legitimate interests. This is covered under the GDPR Article 6(1)(f) - This work is necessary for the purposes of the legitimate interests pursued by the controller or by a third party except where such interests are overridden by the interests or fundamental rights and freedoms of the data subject which require protection of personal data, in particular where the data subject is a child.
As set out in the legitimate interest assessment that The Health Foundation have undertaken - the Data is to help achieve the following:
• To improve health service delivery (by evaluating policies and reporting feedback to the NHS and policy makers)
• To make health policy making more effective (the work packages look at specific policy implementation and how this has been effective and feedback will be given to policy makers)
• test innovations and spread what works
• build skills and knowledge (data access will help to evaluate and understand the rising demand for healthcare and plan for the future)
• develop and share evidence on what works and why (through conferences, presentations, and journal articles that will explain outcomes and results that have been generated using the NHS England Data.
The data is also required for service evaluation purposes - meeting the conditions outlined as per Article 9 (2)(I) of the GDPR. Processing is necessary for reasons of public interest in the area of public health, such as protecting against serious cross-border threats to health or ensuring high standards of quality and safety of health care and of medicinal products or medical devices, on the basis of Union or Member State law which provides for suitable and specific measures to safeguard the rights and freedoms of the data subject, in particular professional secrecy. The Health Foundation are carrying out service evaluation work as described in this agreement to investigate how the quality of care can be improved.
Swansea University is a processor acting under the instructions of The Health Foundation. NHSE data linked to study data will be stored and analysed in Swansea University's Secure eResearch Platform (SeRP - https://popdatasci.swan.ac.uk/products-services/secure-e-research-platform/). NHS England will provide the relevant records from the HES and deaths datasets to The Health Foundation, then subsequently to Swansea University upon transfer to (SeRP).
The Data will contain no direct identifying data items but will contain a unique person ID which can be used to link the Data with other record level data already held by the recipient.
All NHS England Data will be stored and analysed on Swansea University's SeRP. Off-site storage of data for disaster recovery is provided via AWS region Europe (London) under SeRP AWS account. Data will not be transferred to any other location.
The overall purpose and benefit of this work is to inform the NHS and policy makers about changes in the characteristics and health needs of patients, factors that drive health care utilisation and health outcomes, and variation in health need, and quality of care. The work of The Health Foundation is designed to help the NHS understand the rising demand for health care and to plan for the future. The work packages within this programme will cover a number of thematic areas. These were identified as priorities for care quality and outcomes improvement in the recently published NHS Long Term Plan.
The Data Analytics team within The Health Foundation wish to undertake the following work streams:
Work stream 1: Monitoring trends
The Health Foundation will use patient-level data to summarise national contexts and to monitor local and national trends in secondary care in order to improve understanding of the drivers of demand and quality of patient care. Examples of trends that The Health Foundation wish to monitor include changes in disease (all diseases) prevalence and complexity over time, healthcare take-up and demand for distinct patient groups (e.g. patients with long-term conditions), as well as variations or changes in the characteristics of patients accessing secondary care. Key areas of focus within this theme will be:
• Multimorbidity: understanding the changing profiles and needs of patients with multiple long-term health conditions, following on from previous Health Foundation publications, which found that over half of hospital admissions and outpatient visits are for people living with 2 or more conditions. The Health Foundation aims to understand more about trends in combinations of conditions that patients present with in different parts of secondary care. Another goal of this workstream is to investigate the levels on under-recording of co-morbidities in electronic health records when they are not the primary reason for admission. This will be done by comparing HES-based prevalence estimates to estimates from other data sources, e.g. CPRD (Clinical Practice Research Datalink). The results from these analyses will help the NHS understand the rising demand for health care and to offer insight for policy makers and commissioners to design better quality patient care.
• Health and care inequality: unmet need and unexplained local variation in health care access and health outcomes. This analysis will help to raise awareness about existing and developing health inequalities and support the NHS and policy makers in finding solutions to address them.
• International comparison of quality metrics. Analysts at The Health Foundation will also analyse the data to provide aggregate statistics for international comparative analysis of health care quality, utilisation, cost and outcomes. This will be a contribution to an ongoing collaboration between the Health Foundation and partners from 11 other countries, including Germany, France, Australia and the USA. The aim is to compare how healthcare spending and demand for high-cost patients differs between countries. Understanding the differences between countries and their approaches will help to inform better management of these patient groups in the NHS. Note that for this project, only aggregate statistics with small numbers suppressed in line with NHS England guidance will be shared with colleagues overseas. These will be checked to ensure that no patient can be identified, and that the statistics contain no confidential information. No individual patient data will be shared. The collaborators do not have any influence on the means by which the data at the Health Foundation are being analysed.
• Patterns in healthcare demand and utilisation. Work will analyse the dataset to examine trends in demand for emergency and elective care over time and impact on patient outcomes (such as 30-day and 1-year mortality and 30-day readmission). This will also examine the impact of changing performance of hospital providers for example; changes to bed occupancy rates, A&E performance and waiting times.
Work-stream 1 will require linked patient-level Accident & Emergency/Emergency Care Data Set, Admitted Patient Care, Critical Care, Outpatient and Civil Registration Data for years 2008/2009 to current and future data up to 2023, for the whole population. To assess historical trends, access to a long time-series of data is required. To assess the health of children and young people, which is of particular interest in the mental health trends and examining trends in healthcare utilisation over time, a whole population sample is required. To assess outcomes, will need linked mortality data, including date of death to calculate 30-day all-cause mortality rates following a hospital admission.
Work stream 2: Seasonal variations
As part of the Health Foundation’s ongoing monitoring of winter pressures and the knock-on effect in care quality, analysts from the Data Analytics Team will investigate seasonal variations in A&E attendance and emergency admissions. This will include investigating patient profiles, including a focus on respiratory conditions due to their prevalence during the winter months, and a focus on long-stay patients.
The Health Foundation will undertake analyses that also aims to understand the consequences of winter pressures for other NHS services throughout the rest of the year, particularly on elective care such as outpatient appointments and elective hospital treatments. Key areas within this will be:
• Seasonal analysis of the volume of elective care and outpatient appointments with respect to geographical variation. This analysis will support policymakers and commissioners in planning for winter, as it will provide insight into areas that will require additional support.
• Cancellation of elective care in winter and their effect on demand and waiting times during other times of the year.
• Seasonal variation of length of stay for elective admissions and association with patient outcomes, such as emergency readmission and mortality.
This analysis will require linked patient-level inpatient and outpatient as well as mortality data, including date of death to calculate 30-day all-cause mortality rates following a hospital admission. This analysis will require data for years 2008/2009 to current and future data up to 2023, because it is important for this work to see whether changes in health service performance over time is affected by seasonal demand and variation. For example, were Health Foundation analysts to use the data from the recent years to see whether demand for health services increased in winter or summer, it would be useful to know whether these are recent phenomenon or whether such seasonal variations existed previously. This is important as The Health Foundation wouldn’t wish to make policy recommendations based on one-off ‘chance’ events, and therefore this justifies why it is necessary to look at seasonal variations within a fairly long-time frame - so that informed proposals can be made.
Work stream 3: Emergency hospital admissions and same-day emergency care
As part of the NHS Long Term Plan, NHS England is aiming to reduce pressure on emergency hospital services by reducing overall emergency admissions and by increasing the proportion of ‘zero-day admissions’ by providing Same Day Emergency Care (SDEC), which is also known as ambulatory emergency care.
The analysis for this workstream will investigate patient and provider characteristics associated with zero-day and 1+ day emergency admissions. Analysts will assess the effect on health outcomes, including 30-day readmission rates and mortality, compared to patients with longer hospital admissions. In addition, the effect of zero-day admissions at provider level will be analysed to explore geographical variation. This will be done using performance measures including A&E waiting times, inpatient bed days, bed occupancy, stranded patients and delayed transfers of care. This analysis will inform policymakers about progress in the implementation of the service changes set out in the NHS Long Term Plan and will provide insight into their effect on quality of patient care.
This analysis will require linked patient-level Accident & Emergency/Emergency Care Data Set, Admitted Patient Care, Critical Care, Outpatient for years 2008/2009 to current and future data up to 2023. so that progress of the implementation of this new care model can be monitored. The NHS Long-Term plan introduces a number of policy initiatives. In order to see how these initiatives will impact hospital emergency admissions, it is important to analyse emergency admissions data over time. For example, if between 2008 and 2018, The Health Foundation analyse a trend which then changes because of the implementation of a new policy, then the true effects of the policy can be determined. If The Health Foundation only used a short time period for analysis, then the significance of the impact of the change in policy would be more difficult to ascertain. Therefore, analysts require a fairly good run of years of data to be able to undertake a robust policy analysis.
Workstream 4: Outpatient care
Over the last decade the number of hospital outpatient appointments in England has almost doubled from 54 to 94 million yearly attendances. Outpatient care currently represents the largest proportion of NHS contact with patients in a hospital setting and accounts for around £8 billion in yearly healthcare expenditure.
The analysis for this workstream aims to provide new insight into quality of outpatient care by descriptively characterising outpatient journeys, focusing on patient characteristics and complexity, provider and appointment characteristics. Trends will be monitored over time, and an assessment of how these factors relate to case-mix in outpatient clinics and analyse geographical variation and variation associated with socioeconomic deprivation. This will provide commissioners, national and local healthcare leaders with better evidence on the patient need and current quality of outpatient care, in order to support them in finding solutions to meet these needs.
After a decade of substantial yearly growth, the number of outpatient appointments has remained constant since 2016/17. In the NHS Long Term Plan, this was attributed to the fact that GP referrals had been successfully constrained in recent years. The Health Foundation will dedicate part of the analysis to investigating the effect of this recent policy change by analysing the characteristics of patients that were not referred as a result and what the effect on outcomes was. This will include the effect on utilisation of other services as well as patient outcomes, such as emergency admissions and mortality.
One in five outpatient appointments in England are reported as cancelled by the patient or the hospital or as ‘did not attend’ (DNA). Missed or cancelled appointments have financial and operational implications for the NHS but can also have negative effects on quality of care and patient outcomes. This analysis will use patient-level data to investigate appointments that are frequently cancelled or missed, as well as geographical variation in cancellations and non-attendances and any links to socioeconomic deprivation. Included in this analysis will be an investigation as to whether the frequency of outpatient appointments, as well as the number of cancelled and missed appointments, is associated with patient outcomes, such as emergency re-admissions and mortality. This will also include comparisons between conventional and novel statistical approaches. This analysis will support policymakers and practitioners in understanding and avoiding non-attendances in outpatient care, which help to improve the efficiency of outpatient clinics and the quality of patient care.
This work stream will require linked patient-level inpatient and outpatient data, as well mortality data, including variables on date and cause of death.
As above, as the Health Foundation are (as part of this Work Stream) looking into policy change. A longer time span of data is required so that the full effect from the implementation of the policy can be analysed, so the true effects can be determined.
The Health Foundation wishes to process these data in order to describe and assess local and national trends in demand for secondary health care. This includes examining patterns and trends pertaining to individuals and their healthcare demands and take-up of healthcare services, in particular, those individuals with multiple health conditions, inequalities in healthcare demand. Furthermore, processing will be undertaken so that these trends can be compared with trends from other countries. In addition, data will be processed to examine seasonal variation in healthcare demand, the characteristics of patients demanding A&E services, and the demand for outpatient services.
By processing these data to generate these trends, The Health Foundation will be able to inform the health service about the situation of healthcare demand, take-up and treatment for the NHS in England. This will provide policymakers with a picture of the state of the health service demand, particularly for individuals with more than one health condition, as well as the extent to which inequalities exist. This information obtained from processing the data will provide the evidence-base for which policymakers can act to make improvements to patient healthcare. This fits with the remit of The Health Foundation, which is to bring about better health and healthcare for people living in the UK. This is essential work as demand for healthcare services continues to increase, due to an aging population, and healthcare providers continue to operate in a tight financial environment.
If the data were unavailable, The Health Foundation would not be able to undertake the work described above, and the benefits stated could not be realised. The Health Foundation has considered using aggregate sources of data for this work, but these have limitations: they have been created in a way which does not enable The Health Foundation to undertake the specific trends in healthcare that the organisation believe is important to contribute to public understanding about the health service.
The Health Foundation will be complying with UK GDPR, in particular, that data will be used for a legitimate interest, and safeguards will protect the special categories of data used for this workstream.
As mentioned previously, processing the data will enable The Health Foundation to produce analysis relating to national trends of health service utilisation. Patient-level data are required to control for several characteristics to prevent biased statistical results from being produced. The Health Foundation seeks to avoid producing misleading analyses, and therefore it is important to use patient-level data to correctly build an accurate picture of healthcare demand and utilisation in England.
In doing so, The Health Foundation believes that the data processing is proportionate to the purpose for which it seeks to use data. There is a relatively low risk that patient data could be exposed, because of the security measures in place for protecting the data, and there is much benefit that will be realised from undertaking this analysis.
Despite the fact that the Data will be pseudonymised, the Data may contain information about children and other vulnerable people owing to the fact that The Health Foundation has not restricted the Data on the basis of age, disability etc. for the analysis. Trends pertaining to all patients and their use of the health service will be generated, although broken down by age group.
The Health Foundation is an independent charity that exists to further progress and improve the health care of the nation. As a charity independent of government funding, and any other interests, it endeavours to make the public aware that the use of patients’ data is solely for the purpose of improving the health service and treatments that patients receive.
There will be no impact on the data subjects (patients) whose data will be included in the extract received by The Health Foundation. Safeguards are in place to ensure that no individual data will be released from it’s accredited secure data environment in which the data will be processed; further checks will be applied to ensure that no statistical results published could reveal the identity, and/or confidential information, about any individual. Processing such data in a secure data environment is typical for organisations such as The Health Foundation, and guidance on security accreditation is sought and applied from a number of organisations including NHS England, Office for National Statistics, UK Data Service and HMRC (His Majesty's Revenue and Customs) Data lab. Information about the use of patient data is available on The Health Foundation website.
Processing activities
For this programme of work data will be processed by a limited number of analysts within the Health Foundation’s Secure Data Environment. Research and Analysis comprise of some 60 staff currently; only a limited number of these will access the data because access is managed on a need-to-access basis.
All researchers with access to the data will have completed information governance and data security training, as well as training specific to the Health Foundation’s infrastructure, and signed a non-disclosure agreement and the terms of use of the Foundation's Secure Data Environment. The Secure Data Environment is recognised for the NHS England Data Security and Protection Toolkit and is accredited under the ISO27001 security standard. This means several processes and policies are in place to ensure the confidentiality of data held for the purposes outlined above, is maintained.
The data will only be analysed on The Health Foundation's Secure Data Environment. This is a separate secure network accredited to ISO27001 information security standard, and the NHS England Data Security and Protection Toolkit. The data may be accessed from a user's home location or from the Health Foundation's premises only and will be accessed using The Health Foundation provided IT equipment only. Any outputs generated from the data for presentation will be in the form of aggregated outputs, with small number suppression applied in line with the HES analysis guide.'.
The following describes the processing activities for each individual work stream:
Work Stream A: Data management and cleaning pipeline
As The Health Foundation have used HES data in the past, the Data Analytics team have experience of ‘cleaning’ and organising the data in preparation for analyses. This is important for understanding any data limitations which could affect the interpretation of analyses; it reduces the risk of analysts misunderstanding the data, and ensures data are organised and can be processed consistently throughout the different work streams (which are listed subsequently). This workstream is about undertaking this cleaning upon receipt of data, and for the quarterly updates.
Cleaning and organising the data is the first preliminary and necessary step for accomplishing the goals set out in the other work streams (see Objectives), which will lead to patient benefits. For reasons of transparency (under Article 9 of the GDPR) and because putting the HES data files together (e.g. Outpatients, A&E etc.) into a usable analytical resource is intensive and significant work, The Health Foundation believe it useful to include this information in the application because the cleaning work is a form of data processing that will serve the purposes and objectives outlined in the work streams.
Within this pipeline, data will be combined with other publicly available data sources, which will not contain any detail that might lead to increased identification risk of individual patients, but rather add contextual information at an aggregate level. These other data sources will be combined with the data applied for using the geography data items provided, such as Lower Super Output Area (LSOA). For example, it is possible to determine using publicly available data that certain LSOAs will be ‘urban’ or ‘rural’. This demonstrates that patient information from HES will only be combined with the external sources stated below using aggregate data items, not information unique to individual patients.
The external data sources that the data will be combined with include:
Geographical information, including Rural/Urban indicators. Patient characteristics are likely to change between rural and urban areas, and the way in which health services are delivered are likely to differ too. Picking up the differences between rural and urban locations is important for producing statistically robust analyses.
Workforce information, including GP full-time equivalents per GP practice. The way in which services are delivered and benefit patients will be affected by health service workforce levels (such as manpower and skills). In evaluating the quality of health care provided, it is important to take account for health service workforce information.
Socioeconomic deprivation, including Index of Multiple Deprivation. Patients will be living in areas of low, medium or high deprivation, for example. For this application, The Health Foundation is not interested in the deprivation status of individual patients. But understanding the general geographic area in which they live with respect to deprivation will help explain why and how health services are delivered.
Provision and performance of other healthcare services at a CCG or GP level, e.g. opening hours, GP patient survey results, Quality and Outcomes Framework performance. This information is important to factor into analyses: by ensuring that the Health Foundations methods take account of performance of different health services and how they affect patient outcomes will ensure that assessing the quality and trends of health care provision are accurate.
The Data will be used exclusively for the purposes stated in this application.
For this programme of analysis, the in-house data analytics team require person-level data linked across for inpatient (Elective, non-elective and day case), outpatient, A&E/ECDS, critical care and mortality data. The data required within this project are:
• HES Admitted Patient Care Data from 2008/09 to current and future data up to 2028
• HES Outpatient Data from 2008/09 to 2018/19 to current and future data up to 2028
• HES Critical Care Data from 2008/09 to 2018/19 and to current and future data up to 2028
• HES Accident and Emergency data from 2008/09 to Month 13 2019/20
• Emergency Care Data Set data from 2020 to current and future data up to 2028
• Civil Registration Mortality data between 2008/09 and to current and future data up to 2028
• HES/Civil Registration Bridge File - Quarterly Updates to facilitate linkage.
To monitor ongoing changes during the implementation of new models of care and their effect on care quality, and the implementation of the NHS Long Term Plan, The Health Foundation require quarterly data updates.
The amount of data has been limited to the minimum amount required for this programme of work. Although The Health Foundation has previously received other HES data (linked to mortality data), these were created for different purposes (specifically for the purposes described under DARS-NIC-15411: funding pressures). As such, the data extracts were defined specifically for that work; much of the data required to undertake the objectives specified above require up-to-date and different data items than were specified in this previous DARS application. To be clear data previously disseminated under DARS-NIC-15411 will not be used for this programme of work.
Other justifications for the use of data include:
• Geography: healthcare utilisation displays a lot of regional variation. To monitor national and local trends as well as seasonal variation, all geographical areas need to be covered.
• Time coverage: analysis of trends over time requires rich historical data on seasonal variation, business and economic cycles and long-term trends. For this reason, the Health Foundation require access to data from the last 10 years.
• Population: several work streams aim to cover hospital utilisation of the whole population. Focus on teen mental health will require patients aged under 18 years.
• Variables: costing variables are required for international comparison work. Mortality data, including date of death and cause of death, are required to estimate 30-day mortality after hospital admission and to assess whether cause of death was related to the conditions patients were treated for.
For each work stream, the available data dictionary was consulted and a list of data items were drawn up that would be necessary to undertake the analyses. This list of data items was reviewed iteratively by several staff at The Health Foundation to ensure that the data items were necessary and would be used in the analysis process.
Where possible, only data items actually recorded by NHS England, and not derived data items, have been selected. Analysts at The Health Foundation will endeavour to derive new data items if necessary, thus avoiding the dissemination of more data than is required to The Health Foundation. The Health Foundation is only to derive data for the purposes described in this Data Sharing Agreement and not for any other purposes.
The Health Foundation wants to make sure that the analyses undertaken are robust; and that where trends are detected, these are trends and not one-off events. This is important because The Health Foundation wouldn’t wish to make recommendations about how the health service could change based on limited data; but instead undertaking robust analysis requires good data over a length of time so that The Health Foundation can be truly sure of the trends they believe have been detected. For the work streams listed above, The Health Foundation require data back to 2008 because 10 years’ worth of historical data will be enough to undertake a robust trends-analysis.
Expected output
Statistical outputs produced from all projects listed previously will be assessed against best practice guidelines on statistical disclosure control and privacy protection to ensure the confidentiality of the data is maintained. All outputs will contain only data that is aggregated with small numbers suppressed in line with the HES Analysis Guide.
Several publications will be produced from each of the work streams listed under the Purpose section. These publications typically take the form of:
- Reports aimed at policy makers, disseminated through the Foundation’s website. The Health Foundation Communications Team advertises these reports through social media channels, and in addition, senior The Health Foundation staff highlight these reports to contacts throughout the health and social care system (such as at NHS England).
- Peer-reviewed journal articles
- Blogs on the Foundation’s website or others (e.g. Health Service Journal)
- Conferences and presentations
The Health Foundation’s approach to dissemination includes not only publications but also engagement with national policy makers, practitioners and researchers. The Health Foundation’s Communications team will lead on the dissemination of findings. The Health Foundation’s staff regularly speak to senior NHS leaders. For example, The Health Foundation’s report on multiple conditions (https://www.health.org.uk/publications/understanding-the-health-care-needs-of-people-with-multiple-health-conditions) featured in national media in Autumn 2018, in addition to staff at NHS England charged with designing and delivering national policy on integration and personalised care. Furthermore, The Health Foundation regularly liaises with local providers: for example, results of analysis into social isolation, were relayed to Barking and Dagenham in London. This instigated the establishment of a range of projects aimed to tackle social isolation across different age groups.
Wider dissemination of findings takes place via the media, and through social media and direct e-communication with key stakeholders. For example, a previous publication using HES data, on emergency admissions received extensive coverage in the trade media, support via social media from relevant royal colleges and other stakeholders, and exclusive national press coverage in The Times. Other publications from the team have received similar or greater coverage from media, and strong engagement on social media.
Planned publications:
• Health foundation briefing on trends in emergency admissions since the last Health Foundation analysis published in 2021
• Health Foundation briefing on the effects of implementation of same-day emergency care (planned for 2021, once data for the financial year 2019/20 is available)
• Health Foundation publication on elective care investigating seasonal demand and demand management practices 2021 and 2023.
• Health Foundation report on outpatient appointments
• Peer-reviewed publication(s) on outpatient journeys and the effect of missed/cancelled appointments to be published in BMJ, PloS Medicine, BMJ quality and safety or similar.
• Health Foundation publication on mental health (national trends analysis), 2021
• Peer-reviewed publication(s) on international comparisons of care quality to be published in BMJ, PloS Medicine, BMJ Quality and Safety or similar (ongoing 2021, 2022, 2023).
• Health Foundation publication on trends in care quality, and impact of major system changes, 2021 and 2023
Expected measurable benefits
The Health Foundation works closely with key stakeholders and has strong links with NHS teams, national policymakers (e.g. NHS England) and patient advocacy groups, and the findings of this analysis will be shared with these stakeholders to inform their work. Recent publications from the team have been referenced by national policy makers in publications such as the Long Term Plan and the Universal Model of Personalised Care (from NHS England).
As outlined in the Health Foundation’s strategy, the overall aim of The Health Foundation’s analytical work is to inform health policy and help shape strategy in the NHS. As the focus of the analysis covers key areas identified in the NHS Long Term Plan, The Health Foundation will provide evidence on topics that are highly relevant to policy makers and health care leaders.
*Workstream 1: Monitoring trends*
• Analyses generated from the ‘Objectives for processing’ descriptions on changes and trends in patient profiles and health care need will help the NHS understand the rising demand for health care. Identifying and describing unmet patient need or gaps in the service will offer insight and solutions that will improve the quality patient care. This will enable policymakers and commissioners to direct their effort in a way that most effectively improves patient quality of patient care, particularly for patients with multiple conditions, and with mental health conditions. One example is The Health Foundation’s work on weekend mortality (DARS-NIC-35820-Y3H1M), in which a blog (https://www.health.org.uk/blogs/the-importance-of-good-quality-hospital-data) was published and led to interest by policymakers. Broadly, the published work of The Health Foundation’s Data Analytics team can be found here: https://www.health.org.uk/what-we-do/quality-and-data-analytics/in-house-data-analytics.
The analyses generated for this work will inform policymakers and the NHS about the unwanted variation in care quality and will identify geographical areas or patient groups which are disproportionately affected by health inequalities. This information can then be used by commissioners including NHS England to identify priority areas for reducing inequality, in line with the mandate from Government. Although commissioners of health services are not formally engaged at present, as initial results from analyses are generated, a number of agencies with whom The Health Foundation have good relationships with will be approached. This includes Camden and Islington CCG, Barking and Dagenham local authority, South London and Maudsley NHS Trust (SLaM). A broader communications plan will be developed when the nature of the results, and the relevance of these results to policymakers, becomes clear. It is difficult to be more precise before analysis begins.
The overall benefit of this work is that policymakers and commissioners can use the findings in targeting specific cohorts in the population where inequality is particularly high. Existing initiatives aimed at reducing inequality can be assessed, and better evidence will inform debates on inequality more widely this work will help to provide evidence, which can be used to raise awareness and inform the public discussion about existing and developing health inequalities. It will also support health care leaders and policy makers in addressing them by providing evidence on the effects of policies intended to reduce health and care inequalities.
The analyses from this work will illustrate the changes in healthcare quality and demand in response to major system initiatives set out in the NHS Long Term Plan, such as the redesign of emergency or outpatient services. This will support system leaders in setting national and local priorities for service redesign, provide evidence on the progress implementation and will therefore help to realise the intended financial benefits for the NHS.
The Health Foundation’s work on tracking trends and indicators nationally and internationally will help inform policymakers about the quality of care in comparison to other countries and will provide insight into areas where the UK could do better.
The expected benefits stated above for this particular project demonstrate the ‘legitimate interest’ (Article 6(1)(f)) of the Health Foundation in the following ways. Benefits that patients will accrue as a result of this analysis outweighs by a larger proportion any of the relatively minor risks that a patient is harmed through the remote possibility of re-identification and/or release of their personal special categories of data. This fits within the remit of The Health Foundation which is to improve the health and healthcare of people in the UK. It is necessary to use the Data in order to put together local and national trends which in turn will lead to the benefits described above, i.e. assessment of fluctuations in demand for health services, to show where variations in equality exist, and to make sure that improvements are made about how health services and quality health care are delivered.
*Workstream 2: Seasonal variations*
Recent years have witnessed pressure on healthcare services in the NHS, particularly in the winter months. Other seasonal variations may occur too, for example, as patients are admitted due to illness related to heat and other climate change effects. It is likely that seasonal variations will not only persist but increase.
Planning for such variation is crucial for ensuring that the health service can deliver quality patient care; funding and resources need to be in place at the right time. Predicting when additional demand, and the type of demand, is crucial for service providers to plan and ensure that health care can be delivered. The results of this analysis will enable providers to use evidence to adjust resources accordingly in advance and to be aware of when seasonal fluctuations in demand are likely to occur.
A positive outcome can be measured by, for example, bed occupancy rates. Where these exceed 100 per cent, this may be evidence of resources not being sufficiently or efficiently distributed. Other outcomes, such as A&E attendance etc. during periods of high seasonal demand, can be measured. Benefits of this work if policymakers are able to plan for seasonal variation could be measured by e.g. smaller A&E attendance figures.
The expected benefits stated above for this particular project demonstrate the ‘legitimate interest’ (Article 6(1)(f)) of the Health Foundation in the following ways. Benefits that patients will accrue as a result of this analysis outweighs by a larger proportion any of the relatively minor risks that a patient is harmed through the remote possibility of re-identification and/or release of their personal special categories of data. This fits within the remit of The Health Foundation which is to improve the health and healthcare of people in the UK. It is necessary to use the Data in order to put together an analysis of when and how seasonal variations in healthcare demand occur, the analysis could not be undertaken otherwise, and it is expected that health service resources will be better organised to improve patient outcomes as a result of using data about patients’ and their treatments.
*Work stream 3: Emergency hospital admissions and same-day emergency care*
Understanding the characteristics of patients that enter A&E is important to designing A&E services. Similarly, understanding the characteristics of how A&E services are organised is important for understanding the outcomes of patients. Therefore, this work will benefit patients by providing recommendations to the NHS about how A&E and other inpatient services could be organised so that efficient outcomes are achieved, and the best health outcomes are achieved by patients.
Similarly, where geographical variation is detected, then services could be organised and/or resources targeted at areas of the country that lag behind others with respect to patient outcomes and the performance of healthcare providers.
The expected benefits stated above for this particular project demonstrate the ‘legitimate interest’ (Article 6(1)(f)) of the Health Foundation in the following ways. Benefits that patients will accrue as a result of this analysis outweighs by a larger proportion any of the relatively minor risks that a patient is harmed through the remote possibility of re-identification and/or release of their personal special categories of data. This fits within the remit of The Health Foundation which is to improve the health and healthcare of people in the UK. It is necessary to use the Data in order to put together an analysis of the characteristics of patients who attend A&E services, and of the providers delivering A&E healthcare. Without individual patient data, in pseudonymised form, it would not be possible to infer what kind of patients demand A&E services, in what circumstances they demand these services, and what the outcomes of patients are. Therefore, it would not be possible to deliver a set of recommendations about how A&E services are delivered.
*Workstream 4: Outpatient care*
As stated previously, demand for outpatient services has increased markedly over the last few years. Understanding the characteristics of patients who demand such services will enable providers to plan efficient allocation of these services; where additional resources are required, it is important that these are identified.
Understanding why demand for outpatient services has increased so much will enable The Health Foundation to make recommendations to policy providers about how these services can be provided in the most efficient way while achieving the best possible outcomes for the patients who use these services. The alternative is that demand for these services continues to grow, but without efficient organisation of service provision, outpatient services will work ineffectively.
The expected benefits stated above for this particular project demonstrate the ‘legitimate interest’ (Article 6(1)(f)) of the Health Foundation in the following ways. Benefits that patients will accrue as a result of this analysis outweighs by a larger proportion any of the relatively minor risks that a patient is harmed through the remote possibility of re-identification and/or release of their personal special categories of data. This fits within the remit of The Health Foundation which is to improve the health and healthcare of people in the UK. It is necessary to use the Data in order to put together an analysis of the characteristics of patients who demand outpatient services. Since the demand for outpatient services has grown significantly, it is likely that patients will differ in their characteristics and reason for using outpatient services significantly. Understanding these differences are critical for being able to analyse demand for outpatient services and for making recommendations about what could work to deliver improved outcomes for patient care.
The Health Foundation assesses the impact of the analyses using objective measures (e.g., number of publication downloads, publication citations and attendances at events and seminars) and records specific instances where The Health Foundations work has informed decision making for the NHS and improved the quality of care ultimately delivered to patients.
As a non-profit organisation, the Health Foundation’s mission is to maximise the public benefit and the impact of the research that is produced in-house. The aim is to produce useful evidence that can inform better policy and ultimately improve health and health care. This is why The Health Foundation target specific areas of interest for policy and NHS users that are less explored and particularly complex to analyse, as is the case for health inequalities.
• The Health Foundation has strong links with NHS teams, national policymakers (e.g., NHS England) and patient advocacy groups:
• Senior members of Health Foundation staff regularly meet with senior representatives from across government, including the Treasury, Department of Health and Arms-Length Bodies (e.g. Monitor, CQC, NHS England, HEE).
• The Health Foundation is currently working on joint projects with NHS organisations. One example is the partnership with NHS England in evaluating new models of care outlined in the Five Year Forward view (http://www.health.org.uk/programmes/projects/improvement-analytics-unit).
• People across the Health Foundation regularly engage with policy makers at all levels on a range of topics where The Health Foundation have particular expertise: policy, data analytics, economics, patient safety and person-centred care. Health Foundation views are regularly sought on health policy and practice, meaning that the findings from these HES-based analyses will be communicated directly with policymakers.
• The Health Foundation have a long history of funding programmes across the NHS which help to improve the quality of health care. For example, funding work on the relationship between patient flow, costs and outcomes in two NHS hospital trusts, which is related to the new project on understanding the drivers of A&E attendances.
• The Health Foundation have an active audience of professionals working in the NHS, many of whom are fellows sponsored by the Health Foundation, award-holders or part of Health Foundation alumni.
From March 2020, analysis under Workstream 1 ‘Monitoring Trends’ has begun, looking specifically at trends in demand for A&E services. There were several outputs from this work which analysed historical trends (workstream 1) and seasonal variation (workstream 2) of elective and emergency admissions, in order to develop a modelling approach for optimal allocation of elective care capacity during the pandemic.
Benefits reported so far
This Agreement mentions 4 Workstreams (1-4), and in addition, Workstream A in the Processing Activities section.
Workstream A is about cleaning and tidying up the data, making the data ready for analysis (for Workstreams 1-4). This is what The Health Foundation calls the HES Data Pipeline.
This work has been successfully completed. The work began when the data was originally received, and the Pipeline was completed in February 2020.
A large amount of work was undertaken to organise the data, clean, check for errors and quality issues, and could sensibly incorporate updates (quarterly updates of HES). A number of checks and tests were put in place to make sure The Health Foundation would be able to use consistent and sensible data for workstreams 1-4.
During 2020/21 analysis under Workstream 1 ‘Monitoring Trends’ was directed towards looking specifically at trends in demand for A&E services. This work analysed historical trends (workstream 1) and seasonal variation (workstream 2) of elective and emergency admissions, and outputs (tabulated data, with small numbers suppressed) from the data under this Agreement, were used to collaborate with Imperial College London to develop a modelling approach for optimal allocation of elective care capacity during the COVID-19 pandemic. The benefits from this modelling have helped the NHS policy makers make decisions regarding allocation of resources in order to reduce the waiting list of non-COVID related hospital treatments.
During 2021/2022 the focus was examining hospital length of stay and how it varies across hospital trusts, discharge destinations, and re-admission rates (workstream 3). The initial approach involved identifying key patient personas (e.g., hip fracture surgery) to facilitate comparability between trusts. The exploratory phase will focus on assessing feasibility, particularly the completeness and quality of discharge destination data, while also testing different patient personas. The full benefits are yet to be realised as analysis is ongoing.
During 2022/2023 Additionally, the analysis contributed to the evaluation of a risk stratification tool for managing elective waiting lists (workstream 4), aiming to prioritise patients based on clinical urgency and resource availability. Furthermore, the work included an evaluation of GP payment methods, assessing their impact on service delivery and patient outcomes. Insights from this research have informed NHS policymakers in resource allocation decisions to help address the backlog of non-COVID hospital treatments. As analysis continues, further benefits are expected to emerge.
Datasets on the current version
Legal basis for provision: Health and Social Care Act 2012 – s261(2)(a); Health and Social Care Act 2012 - s261 - 'Other dissemination of information'
| Dataset | Type of data | Sensitivity | Frequency | Confidential data |
|---|---|---|---|---|
| Civil Registrations of Death | Anonymised - ICO Code Compliant | Sensitive | Ongoing | Does not include the flow of confidential data |
| Civil Registrations of Death - Secondary Care Cut | Anonymised - ICO Code Compliant | Sensitive | Ongoing | Does not include the flow of confidential data |
| Emergency Care Data Set (ECDS) | Anonymised - ICO Code Compliant | Sensitive | Ongoing | Does not include the flow of confidential data |
| HES-ID to MPS-ID HES Accident and Emergency | Anonymised - ICO Code Compliant | Non-Sensitive | One-Off | Does not include the flow of confidential data |
| HES-ID to MPS-ID HES Admitted Patient Care | Anonymised - ICO Code Compliant | Non-Sensitive | One-Off | Does not include the flow of confidential data |
| HES-ID to MPS-ID HES Outpatients | Anonymised - ICO Code Compliant | Non-Sensitive | One-Off | Does not include the flow of confidential data |
| HES:Civil Registration (Deaths) bridge | Anonymised - ICO Code Compliant | Non-Sensitive | Ongoing | Does not include the flow of confidential data |
| Hospital Episode Statistics Accident and Emergency (HES A and E) | Anonymised - ICO Code Compliant | Non-Sensitive | Ongoing | Does not include the flow of confidential data |
| Hospital Episode Statistics Admitted Patient Care (HES APC) | Anonymised - ICO Code Compliant | Non-Sensitive | Ongoing | Does not include the flow of confidential data |
| Hospital Episode Statistics Critical Care (HES Critical Care) | Anonymised - ICO Code Compliant | Non-Sensitive | Ongoing | Does not include the flow of confidential data |
| Hospital Episode Statistics Outpatients (HES OP) | Anonymised - ICO Code Compliant | Non-Sensitive | Ongoing | Does not include the flow of confidential data |
Files released
Files released counts only files released externally by DARS. Access granted in NHS England's own systems, such as its Secure Data Environment, is not included.
Patient opt-outs were not applied to any of the 222 files released under this agreement, across every version. About opt-outs
No files recorded as released under the current version. 222 were released under earlier versions, shown in the version history.
Version history
The register lists each renewal of this agreement as a separate row. This site has 5 versions.
DARS-NIC-276970-B8Y4H-v4.3 13 August 2026 to 12 August 2027 Added this month
- Title
- Monitoring the quality of healthcare in England
- Commercial
- No
- Sublicensing
- No
- Datasets
- 11
- Files released
- 0
Datasets: Civil Registrations of Death; Civil Registrations of Death - Secondary Care Cut; Emergency Care Data Set (ECDS); HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES-ID to MPS-ID HES Outpatients; HES:Civil Registration (Deaths) bridge; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Critical Care (HES Critical Care); Hospital Episode Statistics Outpatients (HES OP)
What changed from DARS-NIC-276970-B8Y4H-v3.4
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2026-08-13 | |
| End date | 2027-08-12 | |
| Civil Registrations of Death: sensitivity | Sensitive |
Datasets: + HES-ID to MPS-ID HES Outpatients
Objective for processing
[4 paragraphs unchanged]
•produce
• produce
new insights into quality of patient care,
•investigate
• investigate
how the quality of care can be improved
•understand
• understand
the demand for health care in the UK using linked HES data and innovative analytical methods.
[9 paragraphs unchanged]
Amazon Web Services (AWS) is a processor acting under the instructions of The Health Foundation. The role of AWS is limited to cloud storage of the Data only. The Health Foundation expects to transfer all Data from AWS to a Secure eResearch Platform (SeRP) at Swansea University by 31st July 2025.
[2 paragraphs unchanged]
Following the transfer of all Data from The Health Foundation/AWS to Swansea University/SeRP, all
All
NHS England Data will be stored and analysed on Swansea University's SeRP.
[15 words unchanged]
SeRP AWS account. Data will not be transferred to any other location.
[36 paragraphs unchanged]
Expected measurable benefits
[3 paragraphs unchanged]
• Analyses generated from the ‘Objectives for processing’ descriptions on changes and
[73 words unchanged]
health conditions. One example is The Health Foundation’s work on weekend mortality
(DARS-NIC-35820),
(DARS-NIC-35820-Y3H1M),
in which a blog (https://www.health.org.uk/blogs/the-importance-of-good-quality-hospital-data) was published and led to interest by
[5 words unchanged]
of The Health Foundation’s Data Analytics team can be found here: https://www.health.org.uk/what-we-do/quality-and-data-analytics/in-house-data-analytics.
The analyses generated for this work will inform policymakers and the NHS
[83 words unchanged]
Camden and Islington CCG, Barking and Dagenham local authority, South London and
Maudesley
Maudsley
NHS Trust
(SLAM).
(SLaM).
A broader communications plan will be developed when the nature of the
[9 words unchanged]
becomes clear. It is difficult to be more precise before analysis begins.
[26 paragraphs unchanged]
Unchanged: Processing activities, Expected output, Benefits reported.
DARS-NIC-276970-B8Y4H-v3.4 20 March 2025 to 19 March 2028
- Title
- Monitoring the quality of healthcare in England
- Commercial
- No
- Sublicensing
- No
- Datasets
- 10
- Files released
- 36
Datasets: Civil Registrations of Death; Civil Registrations of Death - Secondary Care Cut; Emergency Care Data Set (ECDS); HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES:Civil Registration (Deaths) bridge; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Critical Care (HES Critical Care); Hospital Episode Statistics Outpatients (HES OP)
What changed from DARS-NIC-276970-B8Y4H-v2.12
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2025-03-20 | |
| End date | 2028-03-19 | |
| Civil Registrations of Death - Secondary Care Cut: legal basis | Health and Social Care Act 2012 – s261(2)(a) | |
| Emergency Care Data Set (ECDS): legal basis | Health and Social Care Act 2012 – s261(2)(a) | |
| Hospital Episode Statistics Admitted Patient Care (HES APC): legal basis | Health and Social Care Act 2012 – s261(2)(a) | |
| Hospital Episode Statistics Critical Care (HES Critical Care): legal basis | Health and Social Care Act 2012 – s261(2)(a) | |
| Hospital Episode Statistics Outpatients (HES OP): legal basis | Health and Social Care Act 2012 – s261(2)(a) |
Datasets: + Civil Registrations of Death
Objective for processing
The Health Foundation is an independent charity working to improve health and the quality of healthcare in the United Kingdom. As part of this strategy, the Health Foundation
Data Analytics
Research and Analysis
team analyses data on the quality of health and care.
[1 paragraph unchanged]
The
Data Analytics
Research and Analysis
team
is requesting
requires
access to person-level data for an in-house programme of analyses to be completed over the course of the next 5 years.
[6 paragraphs unchanged]
As set out in the legitimate interest assessment that The Health Foundation have undertaken - the
data requested
Data
is to help achieve the following:
[4 paragraphs unchanged]
• develop and share evidence on what works and why (through conferences,
[5 words unchanged]
will explain outcomes and results that have been generated using the NHS
Digital
England
Data.
[1 paragraph unchanged]
Amazon Web Services (AWS) is a processor acting under the instructions of The Health Foundation. The role of AWS is limited to cloud storage of the Data only. The Health Foundation expects to transfer all Data from AWS to a Secure eResearch Platform (SeRP) at Swansea University by 31st July 2025.
Swansea University is a processor acting under the instructions of The Health Foundation. NHSE data linked to study data will be stored and analysed in Swansea University's Secure eResearch Platform (SeRP - https://popdatasci.swan.ac.uk/products-services/secure-e-research-platform/). NHS England will provide the relevant records from the HES and deaths datasets to The Health Foundation, then subsequently to Swansea University upon transfer to (SeRP).
The Data will contain no direct identifying data items but will contain a unique person ID which can be used to link the Data with other record level data already held by the recipient.
Following the transfer of all Data from The Health Foundation/AWS to Swansea University/SeRP, all NHS England Data will be stored and analysed on Swansea University's SeRP. Off-site storage of data for disaster recovery is provided via AWS region Europe (London) under SeRP AWS account. Data will not be transferred to any other location.
[6 paragraphs unchanged]
• International comparison of quality metrics. Analysts at The Health Foundation will
[87 words unchanged]
project, only aggregate statistics with small numbers suppressed in line with NHS
Digital
England
guidance will be shared with colleagues overseas. These will be checked to
[31 words unchanged]
means by which the data at the Health Foundation are being analysed.
[23 paragraphs unchanged]
In requesting to use the data,
The Health Foundation will be complying with
UK
GDPR, in particular, that data will be used for a legitimate interest, and safeguards will protect the special categories of data used for this workstream.
[2 paragraphs unchanged]
The data requested constitute special categories of data under the GDPR, since The Health Foundation has requested medical records pertaining to individuals, albeit in a pseudonymised format.
Despite the fact that the
data
Data
will be pseudonymised, the
data
Data
may contain information about children and other vulnerable people owing to the fact that The Health Foundation has not restricted the
data requested
Data
on the basis of age, disability etc. for the analysis. Trends pertaining
[7 words unchanged]
the health service will be generated, although broken down by age group.
[1 paragraph unchanged]
There will be no impact on the data subjects (patients) whose data
[80 words unchanged]
accreditation is sought and applied from a number of organisations including NHS
Digital,
England,
Office for National Statistics, UK Data Service and HMRC
(Her
(His
Majesty's Revenue and Customs) Data lab. Information about the use of patient data is available on The Health Foundation website.
Processing activities
For this programme of work data will be processed by a limited number of analysts within the Health Foundation’s Secure Data Environment.
Data Analytics
Research
and
Economics
Analysis
comprise of some 60 staff currently; only a limited number of these will access the data because access is managed on a need-to-access basis.
All researchers with access to the data will have completed information governance
[27 words unchanged]
Secure Data Environment. The Secure Data Environment is recognised for the NHS
Digital
England
Data Security and Protection Toolkit and is accredited under the ISO27001 security
[12 words unchanged]
the confidentiality of data held for the purposes outlined above, is maintained.
The data will only be analysed on The Health Foundation's Secure Data Environment. This is a separate secure network accredited to ISO27001 information security standard, and the NHS
Digital
England
Data Security and Protection Toolkit. The data may be accessed from a
[37 words unchanged]
outputs, with small number suppression applied in line with the HES analysis
guide.'
guide.'.
[2 paragraphs unchanged]
As The Health Foundation have used HES data in the past, the
[61 words unchanged]
about undertaking this cleaning upon receipt of data, and for the quarterly
updates that are requested.
updates.
[1 paragraph unchanged]
Within this pipeline, data will be combined with other publicly available data
[31 words unchanged]
be combined with the data applied for using the geography data items
requested,
provided,
such as Lower Super Output Area (LSOA). For example, it is possible
[29 words unchanged]
stated below using aggregate data items, not information unique to individual patients.
[5 paragraphs unchanged]
All data requested
The Data
will be used exclusively for the purposes stated in this application.
[1 paragraph unchanged]
• HES Admitted Patient Care Data from 2008/09 to current and future data up to
2024
2028
• HES Outpatient Data from 2008/09 to 2018/19 to current and future data up to
2024
2028
• HES Critical Care Data from 2008/09 to 2018/19 and to current and future data up to
2024
2028
[1 paragraph unchanged]
• Emergency Care Data Set data from 2020 to current and future data up to
2024
2028
• Civil Registration Mortality data between 2008/09 and to current and future data up to
2024
2028
[2 paragraphs unchanged]
The amount of data
requested
has been limited to the minimum amount required for this programme of
[71 words unchanged]
disseminated under DARS-NIC-15411 will not be used for this programme of work.
[2 paragraphs unchanged]
• Time coverage: analysis of trends over time requires rich historical data on seasonal variation, business and economic cycles and long-term trends. For this reason, the Health Foundation
are requesting
require
access to data from the last 10 years.
[2 paragraphs unchanged]
Considerable effort has been made only to request the absolute minimum number of data items required to do the analyses outlined above.
For each work stream, the available data dictionary was consulted and a list of data items were drawn up that would be necessary to undertake the analyses. This list of data items was reviewed iteratively by several staff at The Health Foundation to ensure that the data items were necessary and would be used in the analysis process.
For each work stream, the available data dictionary was consulted and a list of data items were drawn up that would be necessary to undertake the analyses. This list of data items was reviewed iteratively by several staff at The Health Foundation to ensure that the data items were necessary and would be used in the analysis process. The Health Foundation are confident that the data requested represents the minimum necessary to achieve the analytical process and outcomes stated in this document.
Where possible, only data items actually recorded by NHS England, and not derived data items, have been selected. Analysts at The Health Foundation will endeavour to derive new data items if necessary, thus avoiding the dissemination of more data than is required to The Health Foundation. The Health Foundation is only to derive data for the purposes described in this Data Sharing Agreement and not for any other purposes.
Where possible, only data items actually recorded by NHS Digital, and not derived data items, have been selected. Analysts at The Health Foundation will endeavour to derive new data items if necessary, thus avoiding the dissemination of more data than is required to The Health Foundation. The Health Foundation is only to derive data for the purposes described in this Data Sharing Agreement and not for any other purposes.
The Health Foundation wants to make sure that the analyses undertaken are robust; and that where trends are detected, these are trends and not one-off events. This is important because The Health Foundation wouldn’t wish to make recommendations about how the health service could change based on limited data; but instead undertaking robust analysis requires good data over a length of time so that The Health Foundation can be truly sure of the trends they believe have been detected. For the work streams listed above, The Health Foundation require data back to 2008 because 10 years’ worth of historical data will be enough to undertake a robust trends-analysis.
Although The Health Foundation has requested a number of years of data, this can be justified, in general, for each work stream, by the desire to undertake robust analysis. The Health Foundation wants to make sure that the analyses undertaken are robust; and that where trends are detected, these are trends and not one-off events. This is important because The Health Foundation wouldn’t wish to make recommendations about how the health service could change based on limited data; but instead undertaking robust analysis requires good data over a length of time so that The Health Foundation can be truly sure of the trends they believe have been detected. For the work streams listed above, The Health Foundation have only requested data back to 2008 because ten years’ worth of historical data will be enough to undertake a robust trends-analysis.
Expected measurable benefits
[8 paragraphs unchanged]
The expected benefits stated above for this particular project demonstrate the ‘legitimate
[69 words unchanged]
healthcare of people in the UK. It is necessary to use the
data requested
Data
in order to put together local and national trends which in turn
[29 words unchanged]
are made about how health services and quality health care are delivered.
[4 paragraphs unchanged]
The expected benefits stated above for this particular project demonstrate the ‘legitimate
[69 words unchanged]
healthcare of people in the UK. It is necessary to use the
data requested
Data
in order to put together an analysis of when and how seasonal
[27 words unchanged]
outcomes as a result of using data about patients’ and their treatments.
[3 paragraphs unchanged]
The expected benefits stated above for this particular project demonstrate the ‘legitimate
[69 words unchanged]
healthcare of people in the UK. It is necessary to use the
data requested
Data
in order to put together an analysis of the characteristics of patients
[52 words unchanged]
to deliver a set of recommendations about how A&E services are delivered.
[3 paragraphs unchanged]
The expected benefits stated above for this particular project demonstrate the ‘legitimate
[69 words unchanged]
healthcare of people in the UK. It is necessary to use the
data requested
Data
in order to put together an analysis of the characteristics of patients
[47 words unchanged]
recommendations about what could work to deliver improved outcomes for patient care.
[9 paragraphs unchanged]
Benefits reported
[4 paragraphs unchanged]
During 2020/21 analysis under Workstream 1 ‘Monitoring Trends’ was directed towards looking
[80 words unchanged]
in order to reduce the waiting list of non-COVID related hospital treatments.
The full benefits are yet to be realised as analysis is ongoing.
During 2021/2022 the focus was examining hospital length of stay and how it varies across hospital trusts, discharge destinations, and re-admission rates (workstream 3). The initial approach involved identifying key patient personas (e.g., hip fracture surgery) to facilitate comparability between trusts. The exploratory phase will focus on assessing feasibility, particularly the completeness and quality of discharge destination data, while also testing different patient personas. The full benefits are yet to be realised as analysis is ongoing.
During 2022/2023 Additionally, the analysis contributed to the evaluation of a risk stratification tool for managing elective waiting lists (workstream 4), aiming to prioritise patients based on clinical urgency and resource availability. Furthermore, the work included an evaluation of GP payment methods, assessing their impact on service delivery and patient outcomes. Insights from this research have informed NHS policymakers in resource allocation decisions to help address the backlog of non-COVID hospital treatments. As analysis continues, further benefits are expected to emerge.
Unchanged: Expected output.
Objective for processing
The Health Foundation is an independent charity working to improve health and the quality of healthcare in the United Kingdom. As part of this strategy, the Health Foundation Research and Analysis team analyses data on the quality of health and care.
The Health Foundation is the data controller and also processes the data for this study.
The Research and Analysis team requires access to person-level data for an in-house programme of analyses to be completed over the course of the next 5 years.
The aim of this programme is to:
•produce new insights into quality of patient care,
•investigate how the quality of care can be improved
•understand the demand for health care in the UK using linked HES data and innovative analytical methods.
The overall purpose and benefit of this work is to inform the NHS and policy makers about changes in the characteristics and health needs of patients, factors that drive health care utilisation and health outcomes, and variation in health need, and quality of care. The work of The Health Foundation is designed to help the NHS understand the rising demand for health care and to plan for the future. The work packages within this programme will cover a number of thematic areas. These were identified as priorities for care quality and outcomes improvement in the recently published NHS Long Term Plan.
The Health Foundation are processing the data in line with their charitable goals as part of their legitimate interests. This is covered under the GDPR Article 6(1)(f) - This work is necessary for the purposes of the legitimate interests pursued by the controller or by a third party except where such interests are overridden by the interests or fundamental rights and freedoms of the data subject which require protection of personal data, in particular where the data subject is a child.
As set out in the legitimate interest assessment that The Health Foundation have undertaken - the Data is to help achieve the following:
• To improve health service delivery (by evaluating policies and reporting feedback to the NHS and policy makers)
• To make health policy making more effective (the work packages look at specific policy implementation and how this has been effective and feedback will be given to policy makers)
• test innovations and spread what works
• build skills and knowledge (data access will help to evaluate and understand the rising demand for healthcare and plan for the future)
• develop and share evidence on what works and why (through conferences, presentations, and journal articles that will explain outcomes and results that have been generated using the NHS England Data.
The data is also required for service evaluation purposes - meeting the conditions outlined as per Article 9 (2)(I) of the GDPR. Processing is necessary for reasons of public interest in the area of public health, such as protecting against serious cross-border threats to health or ensuring high standards of quality and safety of health care and of medicinal products or medical devices, on the basis of Union or Member State law which provides for suitable and specific measures to safeguard the rights and freedoms of the data subject, in particular professional secrecy. The Health Foundation are carrying out service evaluation work as described in this agreement to investigate how the quality of care can be improved.
Amazon Web Services (AWS) is a processor acting under the instructions of The Health Foundation. The role of AWS is limited to cloud storage of the Data only. The Health Foundation expects to transfer all Data from AWS to a Secure eResearch Platform (SeRP) at Swansea University by 31st July 2025.
Swansea University is a processor acting under the instructions of The Health Foundation. NHSE data linked to study data will be stored and analysed in Swansea University's Secure eResearch Platform (SeRP - https://popdatasci.swan.ac.uk/products-services/secure-e-research-platform/). NHS England will provide the relevant records from the HES and deaths datasets to The Health Foundation, then subsequently to Swansea University upon transfer to (SeRP).
The Data will contain no direct identifying data items but will contain a unique person ID which can be used to link the Data with other record level data already held by the recipient.
Following the transfer of all Data from The Health Foundation/AWS to Swansea University/SeRP, all NHS England Data will be stored and analysed on Swansea University's SeRP. Off-site storage of data for disaster recovery is provided via AWS region Europe (London) under SeRP AWS account. Data will not be transferred to any other location.
The overall purpose and benefit of this work is to inform the NHS and policy makers about changes in the characteristics and health needs of patients, factors that drive health care utilisation and health outcomes, and variation in health need, and quality of care. The work of The Health Foundation is designed to help the NHS understand the rising demand for health care and to plan for the future. The work packages within this programme will cover a number of thematic areas. These were identified as priorities for care quality and outcomes improvement in the recently published NHS Long Term Plan.
The Data Analytics team within The Health Foundation wish to undertake the following work streams:
Work stream 1: Monitoring trends
The Health Foundation will use patient-level data to summarise national contexts and to monitor local and national trends in secondary care in order to improve understanding of the drivers of demand and quality of patient care. Examples of trends that The Health Foundation wish to monitor include changes in disease (all diseases) prevalence and complexity over time, healthcare take-up and demand for distinct patient groups (e.g. patients with long-term conditions), as well as variations or changes in the characteristics of patients accessing secondary care. Key areas of focus within this theme will be:
• Multimorbidity: understanding the changing profiles and needs of patients with multiple long-term health conditions, following on from previous Health Foundation publications, which found that over half of hospital admissions and outpatient visits are for people living with 2 or more conditions. The Health Foundation aims to understand more about trends in combinations of conditions that patients present with in different parts of secondary care. Another goal of this workstream is to investigate the levels on under-recording of co-morbidities in electronic health records when they are not the primary reason for admission. This will be done by comparing HES-based prevalence estimates to estimates from other data sources, e.g. CPRD (Clinical Practice Research Datalink). The results from these analyses will help the NHS understand the rising demand for health care and to offer insight for policy makers and commissioners to design better quality patient care.
• Health and care inequality: unmet need and unexplained local variation in health care access and health outcomes. This analysis will help to raise awareness about existing and developing health inequalities and support the NHS and policy makers in finding solutions to address them.
• International comparison of quality metrics. Analysts at The Health Foundation will also analyse the data to provide aggregate statistics for international comparative analysis of health care quality, utilisation, cost and outcomes. This will be a contribution to an ongoing collaboration between the Health Foundation and partners from 11 other countries, including Germany, France, Australia and the USA. The aim is to compare how healthcare spending and demand for high-cost patients differs between countries. Understanding the differences between countries and their approaches will help to inform better management of these patient groups in the NHS. Note that for this project, only aggregate statistics with small numbers suppressed in line with NHS England guidance will be shared with colleagues overseas. These will be checked to ensure that no patient can be identified, and that the statistics contain no confidential information. No individual patient data will be shared. The collaborators do not have any influence on the means by which the data at the Health Foundation are being analysed.
• Patterns in healthcare demand and utilisation. Work will analyse the dataset to examine trends in demand for emergency and elective care over time and impact on patient outcomes (such as 30-day and 1-year mortality and 30-day readmission). This will also examine the impact of changing performance of hospital providers for example; changes to bed occupancy rates, A&E performance and waiting times.
Work-stream 1 will require linked patient-level Accident & Emergency/Emergency Care Data Set, Admitted Patient Care, Critical Care, Outpatient and Civil Registration Data for years 2008/2009 to current and future data up to 2023, for the whole population. To assess historical trends, access to a long time-series of data is required. To assess the health of children and young people, which is of particular interest in the mental health trends and examining trends in healthcare utilisation over time, a whole population sample is required. To assess outcomes, will need linked mortality data, including date of death to calculate 30-day all-cause mortality rates following a hospital admission.
Work stream 2: Seasonal variations
As part of the Health Foundation’s ongoing monitoring of winter pressures and the knock-on effect in care quality, analysts from the Data Analytics Team will investigate seasonal variations in A&E attendance and emergency admissions. This will include investigating patient profiles, including a focus on respiratory conditions due to their prevalence during the winter months, and a focus on long-stay patients.
The Health Foundation will undertake analyses that also aims to understand the consequences of winter pressures for other NHS services throughout the rest of the year, particularly on elective care such as outpatient appointments and elective hospital treatments. Key areas within this will be:
• Seasonal analysis of the volume of elective care and outpatient appointments with respect to geographical variation. This analysis will support policymakers and commissioners in planning for winter, as it will provide insight into areas that will require additional support.
• Cancellation of elective care in winter and their effect on demand and waiting times during other times of the year.
• Seasonal variation of length of stay for elective admissions and association with patient outcomes, such as emergency readmission and mortality.
This analysis will require linked patient-level inpatient and outpatient as well as mortality data, including date of death to calculate 30-day all-cause mortality rates following a hospital admission. This analysis will require data for years 2008/2009 to current and future data up to 2023, because it is important for this work to see whether changes in health service performance over time is affected by seasonal demand and variation. For example, were Health Foundation analysts to use the data from the recent years to see whether demand for health services increased in winter or summer, it would be useful to know whether these are recent phenomenon or whether such seasonal variations existed previously. This is important as The Health Foundation wouldn’t wish to make policy recommendations based on one-off ‘chance’ events, and therefore this justifies why it is necessary to look at seasonal variations within a fairly long-time frame - so that informed proposals can be made.
Work stream 3: Emergency hospital admissions and same-day emergency care
As part of the NHS Long Term Plan, NHS England is aiming to reduce pressure on emergency hospital services by reducing overall emergency admissions and by increasing the proportion of ‘zero-day admissions’ by providing Same Day Emergency Care (SDEC), which is also known as ambulatory emergency care.
The analysis for this workstream will investigate patient and provider characteristics associated with zero-day and 1+ day emergency admissions. Analysts will assess the effect on health outcomes, including 30-day readmission rates and mortality, compared to patients with longer hospital admissions. In addition, the effect of zero-day admissions at provider level will be analysed to explore geographical variation. This will be done using performance measures including A&E waiting times, inpatient bed days, bed occupancy, stranded patients and delayed transfers of care. This analysis will inform policymakers about progress in the implementation of the service changes set out in the NHS Long Term Plan and will provide insight into their effect on quality of patient care.
This analysis will require linked patient-level Accident & Emergency/Emergency Care Data Set, Admitted Patient Care, Critical Care, Outpatient for years 2008/2009 to current and future data up to 2023. so that progress of the implementation of this new care model can be monitored. The NHS Long-Term plan introduces a number of policy initiatives. In order to see how these initiatives will impact hospital emergency admissions, it is important to analyse emergency admissions data over time. For example, if between 2008 and 2018, The Health Foundation analyse a trend which then changes because of the implementation of a new policy, then the true effects of the policy can be determined. If The Health Foundation only used a short time period for analysis, then the significance of the impact of the change in policy would be more difficult to ascertain. Therefore, analysts require a fairly good run of years of data to be able to undertake a robust policy analysis.
Workstream 4: Outpatient care
Over the last decade the number of hospital outpatient appointments in England has almost doubled from 54 to 94 million yearly attendances. Outpatient care currently represents the largest proportion of NHS contact with patients in a hospital setting and accounts for around £8 billion in yearly healthcare expenditure.
The analysis for this workstream aims to provide new insight into quality of outpatient care by descriptively characterising outpatient journeys, focusing on patient characteristics and complexity, provider and appointment characteristics. Trends will be monitored over time, and an assessment of how these factors relate to case-mix in outpatient clinics and analyse geographical variation and variation associated with socioeconomic deprivation. This will provide commissioners, national and local healthcare leaders with better evidence on the patient need and current quality of outpatient care, in order to support them in finding solutions to meet these needs.
After a decade of substantial yearly growth, the number of outpatient appointments has remained constant since 2016/17. In the NHS Long Term Plan, this was attributed to the fact that GP referrals had been successfully constrained in recent years. The Health Foundation will dedicate part of the analysis to investigating the effect of this recent policy change by analysing the characteristics of patients that were not referred as a result and what the effect on outcomes was. This will include the effect on utilisation of other services as well as patient outcomes, such as emergency admissions and mortality.
One in five outpatient appointments in England are reported as cancelled by the patient or the hospital or as ‘did not attend’ (DNA). Missed or cancelled appointments have financial and operational implications for the NHS but can also have negative effects on quality of care and patient outcomes. This analysis will use patient-level data to investigate appointments that are frequently cancelled or missed, as well as geographical variation in cancellations and non-attendances and any links to socioeconomic deprivation. Included in this analysis will be an investigation as to whether the frequency of outpatient appointments, as well as the number of cancelled and missed appointments, is associated with patient outcomes, such as emergency re-admissions and mortality. This will also include comparisons between conventional and novel statistical approaches. This analysis will support policymakers and practitioners in understanding and avoiding non-attendances in outpatient care, which help to improve the efficiency of outpatient clinics and the quality of patient care.
This work stream will require linked patient-level inpatient and outpatient data, as well mortality data, including variables on date and cause of death.
As above, as the Health Foundation are (as part of this Work Stream) looking into policy change. A longer time span of data is required so that the full effect from the implementation of the policy can be analysed, so the true effects can be determined.
The Health Foundation wishes to process these data in order to describe and assess local and national trends in demand for secondary health care. This includes examining patterns and trends pertaining to individuals and their healthcare demands and take-up of healthcare services, in particular, those individuals with multiple health conditions, inequalities in healthcare demand. Furthermore, processing will be undertaken so that these trends can be compared with trends from other countries. In addition, data will be processed to examine seasonal variation in healthcare demand, the characteristics of patients demanding A&E services, and the demand for outpatient services.
By processing these data to generate these trends, The Health Foundation will be able to inform the health service about the situation of healthcare demand, take-up and treatment for the NHS in England. This will provide policymakers with a picture of the state of the health service demand, particularly for individuals with more than one health condition, as well as the extent to which inequalities exist. This information obtained from processing the data will provide the evidence-base for which policymakers can act to make improvements to patient healthcare. This fits with the remit of The Health Foundation, which is to bring about better health and healthcare for people living in the UK. This is essential work as demand for healthcare services continues to increase, due to an aging population, and healthcare providers continue to operate in a tight financial environment.
If the data were unavailable, The Health Foundation would not be able to undertake the work described above, and the benefits stated could not be realised. The Health Foundation has considered using aggregate sources of data for this work, but these have limitations: they have been created in a way which does not enable The Health Foundation to undertake the specific trends in healthcare that the organisation believe is important to contribute to public understanding about the health service.
The Health Foundation will be complying with UK GDPR, in particular, that data will be used for a legitimate interest, and safeguards will protect the special categories of data used for this workstream.
As mentioned previously, processing the data will enable The Health Foundation to produce analysis relating to national trends of health service utilisation. Patient-level data are required to control for several characteristics to prevent biased statistical results from being produced. The Health Foundation seeks to avoid producing misleading analyses, and therefore it is important to use patient-level data to correctly build an accurate picture of healthcare demand and utilisation in England.
In doing so, The Health Foundation believes that the data processing is proportionate to the purpose for which it seeks to use data. There is a relatively low risk that patient data could be exposed, because of the security measures in place for protecting the data, and there is much benefit that will be realised from undertaking this analysis.
Despite the fact that the Data will be pseudonymised, the Data may contain information about children and other vulnerable people owing to the fact that The Health Foundation has not restricted the Data on the basis of age, disability etc. for the analysis. Trends pertaining to all patients and their use of the health service will be generated, although broken down by age group.
The Health Foundation is an independent charity that exists to further progress and improve the health care of the nation. As a charity independent of government funding, and any other interests, it endeavours to make the public aware that the use of patients’ data is solely for the purpose of improving the health service and treatments that patients receive.
There will be no impact on the data subjects (patients) whose data will be included in the extract received by The Health Foundation. Safeguards are in place to ensure that no individual data will be released from it’s accredited secure data environment in which the data will be processed; further checks will be applied to ensure that no statistical results published could reveal the identity, and/or confidential information, about any individual. Processing such data in a secure data environment is typical for organisations such as The Health Foundation, and guidance on security accreditation is sought and applied from a number of organisations including NHS England, Office for National Statistics, UK Data Service and HMRC (His Majesty's Revenue and Customs) Data lab. Information about the use of patient data is available on The Health Foundation website.
Expected output
Statistical outputs produced from all projects listed previously will be assessed against best practice guidelines on statistical disclosure control and privacy protection to ensure the confidentiality of the data is maintained. All outputs will contain only data that is aggregated with small numbers suppressed in line with the HES Analysis Guide.
Several publications will be produced from each of the work streams listed under the Purpose section. These publications typically take the form of:
- Reports aimed at policy makers, disseminated through the Foundation’s website. The Health Foundation Communications Team advertises these reports through social media channels, and in addition, senior The Health Foundation staff highlight these reports to contacts throughout the health and social care system (such as at NHS England).
- Peer-reviewed journal articles
- Blogs on the Foundation’s website or others (e.g. Health Service Journal)
- Conferences and presentations
The Health Foundation’s approach to dissemination includes not only publications but also engagement with national policy makers, practitioners and researchers. The Health Foundation’s Communications team will lead on the dissemination of findings. The Health Foundation’s staff regularly speak to senior NHS leaders. For example, The Health Foundation’s report on multiple conditions (https://www.health.org.uk/publications/understanding-the-health-care-needs-of-people-with-multiple-health-conditions) featured in national media in Autumn 2018, in addition to staff at NHS England charged with designing and delivering national policy on integration and personalised care. Furthermore, The Health Foundation regularly liaises with local providers: for example, results of analysis into social isolation, were relayed to Barking and Dagenham in London. This instigated the establishment of a range of projects aimed to tackle social isolation across different age groups.
Wider dissemination of findings takes place via the media, and through social media and direct e-communication with key stakeholders. For example, a previous publication using HES data, on emergency admissions received extensive coverage in the trade media, support via social media from relevant royal colleges and other stakeholders, and exclusive national press coverage in The Times. Other publications from the team have received similar or greater coverage from media, and strong engagement on social media.
Planned publications:
• Health foundation briefing on trends in emergency admissions since the last Health Foundation analysis published in 2021
• Health Foundation briefing on the effects of implementation of same-day emergency care (planned for 2021, once data for the financial year 2019/20 is available)
• Health Foundation publication on elective care investigating seasonal demand and demand management practices 2021 and 2023.
• Health Foundation report on outpatient appointments
• Peer-reviewed publication(s) on outpatient journeys and the effect of missed/cancelled appointments to be published in BMJ, PloS Medicine, BMJ quality and safety or similar.
• Health Foundation publication on mental health (national trends analysis), 2021
• Peer-reviewed publication(s) on international comparisons of care quality to be published in BMJ, PloS Medicine, BMJ Quality and Safety or similar (ongoing 2021, 2022, 2023).
• Health Foundation publication on trends in care quality, and impact of major system changes, 2021 and 2023
Benefits reported
This Agreement mentions 4 Workstreams (1-4), and in addition, Workstream A in the Processing Activities section.
Workstream A is about cleaning and tidying up the data, making the data ready for analysis (for Workstreams 1-4). This is what The Health Foundation calls the HES Data Pipeline.
This work has been successfully completed. The work began when the data was originally received, and the Pipeline was completed in February 2020.
A large amount of work was undertaken to organise the data, clean, check for errors and quality issues, and could sensibly incorporate updates (quarterly updates of HES). A number of checks and tests were put in place to make sure The Health Foundation would be able to use consistent and sensible data for workstreams 1-4.
During 2020/21 analysis under Workstream 1 ‘Monitoring Trends’ was directed towards looking specifically at trends in demand for A&E services. This work analysed historical trends (workstream 1) and seasonal variation (workstream 2) of elective and emergency admissions, and outputs (tabulated data, with small numbers suppressed) from the data under this Agreement, were used to collaborate with Imperial College London to develop a modelling approach for optimal allocation of elective care capacity during the COVID-19 pandemic. The benefits from this modelling have helped the NHS policy makers make decisions regarding allocation of resources in order to reduce the waiting list of non-COVID related hospital treatments.
During 2021/2022 the focus was examining hospital length of stay and how it varies across hospital trusts, discharge destinations, and re-admission rates (workstream 3). The initial approach involved identifying key patient personas (e.g., hip fracture surgery) to facilitate comparability between trusts. The exploratory phase will focus on assessing feasibility, particularly the completeness and quality of discharge destination data, while also testing different patient personas. The full benefits are yet to be realised as analysis is ongoing.
During 2022/2023 Additionally, the analysis contributed to the evaluation of a risk stratification tool for managing elective waiting lists (workstream 4), aiming to prioritise patients based on clinical urgency and resource availability. Furthermore, the work included an evaluation of GP payment methods, assessing their impact on service delivery and patient outcomes. Insights from this research have informed NHS policymakers in resource allocation decisions to help address the backlog of non-COVID hospital treatments. As analysis continues, further benefits are expected to emerge.
DARS-NIC-276970-B8Y4H-v2.12 7 March 2022 to 31 January 2025
- Title
- Monitoring the quality of healthcare in England
- Commercial
- No
- Sublicensing
- No
- Datasets
- 9
- Files released
- 66
Datasets: Civil Registrations of Death - Secondary Care Cut; Emergency Care Data Set (ECDS); HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES:Civil Registration (Deaths) bridge; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Critical Care (HES Critical Care); Hospital Episode Statistics Outpatients (HES OP)
What changed from DARS-NIC-276970-B8Y4H-v1.2
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2022-03-07 | |
| End date | 2025-01-31 | |
| Civil Registrations of Death - Secondary Care Cut: legal basis | Health and Social Care Act 2012 - s261 - 'Other dissemination of information' | |
| HES-ID to MPS-ID HES Accident and Emergency: legal basis | Health and Social Care Act 2012 - s261 - 'Other dissemination of information' | |
| HES-ID to MPS-ID HES Admitted Patient Care: legal basis | Health and Social Care Act 2012 - s261 - 'Other dissemination of information' | |
| HES:Civil Registration (Deaths) bridge: legal basis | Health and Social Care Act 2012 - s261 - 'Other dissemination of information' | |
| Hospital Episode Statistics Accident and Emergency (HES A and E): legal basis | Health and Social Care Act 2012 - s261 - 'Other dissemination of information' | |
| Hospital Episode Statistics Admitted Patient Care (HES APC): legal basis | Health and Social Care Act 2012 - s261 - 'Other dissemination of information' | |
| Hospital Episode Statistics Critical Care (HES Critical Care): legal basis | Health and Social Care Act 2012 - s261 - 'Other dissemination of information' | |
| Hospital Episode Statistics Outpatients (HES OP): legal basis | Health and Social Care Act 2012 - s261 - 'Other dissemination of information' |
Datasets: + Emergency Care Data Set (ECDS)
Objective for processing
The Health Foundation is an independent charity working to improve health and the quality of
health care
healthcare
in the United Kingdom. As part of this strategy, the Health Foundation Data Analytics team analyses data on the quality of health and care.
The Health Foundation is the sole data controller and data processor of the data supplied by NHS Digital under this Agreement.
The Health Foundation is the data controller and also processes the data for this study.
[6 paragraphs unchanged]
The Health Foundation are processing the data in line with their charitable
[57 words unchanged]
of personal data, in particular where the data subject is a child.
As set out in the legitimate interest assessment that The Health Foundation have undertaken - the data requested is to help achieve the following:
As set out in the legitimate interest assessment that The Health Foundation have undertaken - the data requested is to help achieve the following:
[1 paragraph unchanged]
• To make health
policymaking
policy making
more effective (the work packages look at specific policy implementation and how this has been effective and feedback will be given to policy makers)
[5 paragraphs unchanged]
How will The Health Foundation achieve this work?
[7 paragraphs unchanged]
Work-stream 1 will require linked patient-level
A&E, inpatient, critical care, outpatient
Accident & Emergency/Emergency Care Data Set, Admitted Patient Care, Critical Care, Outpatient
and
mortality
Civil Registration Data for years 2008/2009 to current and future
data
for the last 10 years (2008/2009
up
to
2018/2019)
2023,
for the whole population. To assess historical trends, access to a long
[48 words unchanged]
of death to calculate 30-day all-cause mortality rates following a hospital admission.
[6 paragraphs unchanged]
This analysis will require linked patient-level inpatient and outpatient as well as
[9 words unchanged]
all-cause mortality rates following a hospital admission. This analysis will require data
from the last 10 years,
for years 2008/2009 to current and future data up to 2023,
because it is important for this work to see whether changes in
[88 words unchanged]
a fairly long-time frame - so that informed proposals can be made.
[3 paragraphs unchanged]
This analysis will require linked
A&E, critical care
patient-level Accident & Emergency/Emergency Care Data Set, Admitted Patient Care, Critical Care, Outpatient for years 2008/2009 to current
and
inpatient
future
data
with quarterly data updates when new data becomes available,
up to 2023.
so that progress of the implementation of this new care model can
[105 words unchanged]
years of data to be able to undertake a robust policy analysis.
[6 paragraphs unchanged]
As above, as the Health Foundation are (as part of this Work
[8 words unchanged]
span of data is required so that the full effect from the
implentation
implementation
of the policy can be analysed, so the true effects can be determined.
The Health Foundation wishes to process these data in order to describe
[25 words unchanged]
and take-up of healthcare services, in particular, those individuals with multiple health
conditions;
conditions,
inequalities in healthcare demand. Furthermore, processing will be undertaken so that these
[23 words unchanged]
characteristics of patients demanding A&E services, and the demand for outpatient services.
[1 paragraph unchanged]
The Health Foundation will undertake this work by itself, and this will not involve participation of third parties.
If the data were unavailable, The Health Foundation would not be able to undertake the work described above, and the benefits stated could not be realised. The Health Foundation has considered using aggregate sources of data for this work, but these have limitations: they have been created in a way which does not enable The Health Foundation to undertake the specific trends in healthcare that the organisation believe is important to contribute to public understanding about the health service.
If these data were unavailable, then The Health Foundation wouldn’t be able to undertake the work described above, and the benefits stated could not be realised. The Health Foundation has considered using aggregate sources of data for this work, but these have limitations: they have been created in a way which does not enable The Health Foundation to undertake the specific trends in healthcare that the organisation believe is important to contribute to public understanding about the health service.
In requesting to use the data, The Health Foundation will be complying with GDPR, in particular, that data will be used for a legitimate interest, and safeguards will protect the special categories of data used for this workstream.
In requesting to use these data, The Health Foundation will be complying with GDPR, in particular, that data will be used for a legitimate interest, and safeguards will protect the special categories of data used for this workstream.
As mentioned previously, processing the data will enable The Health Foundation to produce analysis relating to national trends of health service utilisation. Patient-level data are required to control for several characteristics to prevent biased statistical results from being produced. The Health Foundation seeks to avoid producing misleading analyses, and therefore it is important to use patient-level data to correctly build an accurate picture of healthcare demand and utilisation in England.
As mentioned previously, processing the data will enable The Health Foundation to produce analysis relating to national trends of health service utilisation. Patient-level data are required to control for a number of characteristics to prevent biased statistical results from being produced. The Health Foundation seeks to avoid producing misleading analyses, and therefore it is important to use patient-level data to correctly build an accurate picture of healthcare demand and utilisation in England.
[2 paragraphs unchanged]
The Health Foundation is an independent charity that exists to further progress and improve the health care of the nation. As a charity independent of government
funding ,
funding,
and any other interests, it
endeavors
endeavours
to make the public aware that the use of patients’ data is solely for the purpose of improving the health service and treatments that patients receive.
There will be no impact on the data subjects (patients) whose data
[95 words unchanged]
National Statistics, UK Data Service and HMRC (Her Majesty's Revenue and Customs)
Datalab.
Data lab.
Information about the use of patient data is available on The Health Foundation website.
Processing activities
For this programme of work data will be processed by a limited number of analysts within the Health Foundation’s Secure Data Environment.
All researchers with
Data Analytics and Economics comprise of some 60 staff currently; only a limited number of these will
access
to
the data
will have completed information governance and data security training, as well as training specific to the Health Foundation’s infrastructure, and signed
because access is managed on
a
non-disclosure agreement and the terms of use of the Foundation's Secure Data Environment. The Secure Data Environment is recognised for the NHS Digital Data Security and Protection Toolkit, and is accredited under the ISO27001 security standard. This means that a number of processes and policies are in place to ensure the confidentiality of data held for the purposes outlined above, is maintained.
need-to-access basis.
The data will only be analysed on The Health Foundation’s premises in London. Any outputs generated from the data for presentation will be in the form of aggregated outputs, with small number suppression applied in line with the HES analysis guide.
All researchers with access to the data will have completed information governance and data security training, as well as training specific to the Health Foundation’s infrastructure, and signed a non-disclosure agreement and the terms of use of the Foundation's Secure Data Environment. The Secure Data Environment is recognised for the NHS Digital Data Security and Protection Toolkit and is accredited under the ISO27001 security standard. This means several processes and policies are in place to ensure the confidentiality of data held for the purposes outlined above, is maintained.
The data will only be analysed on The Health Foundation's Secure Data Environment. This is a separate secure network accredited to ISO27001 information security standard, and the NHS Digital Data Security and Protection Toolkit. The data may be accessed from a user's home location or from the Health Foundation's premises only and will be accessed using The Health Foundation provided IT equipment only. Any outputs generated from the data for presentation will be in the form of aggregated outputs, with small number suppression applied in line with the HES analysis guide.'
[3 paragraphs unchanged]
Cleaning and organising the data is the first preliminary and necessary step
[31 words unchanged]
putting the HES data files together (e.g. Outpatients, A&E etc.) into a
useable
usable
analytical resource is intensive and significant work, The Health Foundation believe it
[16 words unchanged]
data processing that will serve the purposes and objectives outlined in the
workstreams.
work streams.
[7 paragraphs unchanged]
For this programme of analysis, the in-house data analytics team require person-level data linked across for inpatient (Elective, non-elective and day case), outpatient,
A&E,
A&E/ECDS,
critical care and mortality data. The data required within this project are:
• HES Admitted Patient Care Data from 2008/09 to
2018/19
current
and
quarterly updates as they become available
future data up to 2024
• HES Outpatient Data from 2008/09 to 2018/19
to current
and
quarterly updates as they become available
future data up to 2024
• HES Critical Care Data from 2008/09 to 2018/19 and
quarterly updates as they become available
to current and future data up to 2024
• HES Accident and Emergency data from 2008/09 to
2018/19 and quarterly updates as they become available
Month 13 2019/20
• Civil Registration Mortality data between 2008/09 and 2018/19 and quarterly updates as they become available.
• Emergency Care Data Set data from 2020 to current and future data up to 2024
• Civil Registration Mortality data between 2008/09 and to current and future data up to 2024
[8 paragraphs unchanged]
Only substantive employees of the Data Controller (The Health Foundation) will access the record level data being shared under this agreement.
[1 paragraph unchanged]
For each work stream, the available data dictionary was consulted and a
[12 words unchanged]
undertake the analyses. This list of data items was reviewed iteratively by
a number of
several
staff at The Health Foundation to ensure that the data items were
[21 words unchanged]
necessary to achieve the analytical process and outcomes stated in this document.
Where possible, only data items actually recorded by NHS Digital, and not
[22 words unchanged]
the dissemination of more data than is required to The Health Foundation.
The Health Foundation is only to derive data for the purposes described in this Data Sharing Agreement and not for any other purposes.
Although The Health Foundation has requested a number of
years’
years
of data, this can be justified, in general, for each work stream,
[16 words unchanged]
analyses undertaken are robust; and that where trends are detected, these are
actually
trends and not one-off events. This is important because The Health Foundation
[36 words unchanged]
truly sure of the trends they believe have been detected. For the
workstreams
work streams
listed above, The Health Foundation have only requested data back to 2008 because ten years’ worth of historical data will be
sufficient
enough
to undertake a robust trends-analysis.
Expected output
[9 paragraphs unchanged]
• Health foundation briefing on trends in emergency admissions since the last Health Foundation analysis published in
2018,
2021
[2 paragraphs unchanged]
• Health Foundation report on outpatient
appointments, 2019
appointments
[1 paragraph unchanged]
• Health Foundation publication on mental health (national trends analysis),
2019 and
2021
[1 paragraph unchanged]
• Health Foundation publication on health and care inequalities, 2020
[1 paragraph unchanged]
Expected measurable benefits
[30 paragraphs unchanged] From March 2020, analysis under Workstream 1 ‘Monitoring Trends’ has begun, looking specifically at trends in demand for A&E services. There were several outputs from this work which analysed historical trends (workstream 1) and seasonal variation (workstream 2) of elective and emergency admissions, in order to develop a modelling approach for optimal allocation of elective care capacity during the pandemic.
Benefits reported
Not stated in the previous version; added here.
This Agreement mentions 4 Workstreams (1-4), and in addition, Workstream A in the Processing Activities section.
Workstream A is about cleaning and tidying up the data, making the data ready for analysis (for Workstreams 1-4). This is what The Health Foundation calls the HES Data Pipeline.
This work has been successfully completed. The work began when the data was originally received, and the Pipeline was completed in February 2020.
A large amount of work was undertaken to organise the data, clean, check for errors and quality issues, and could sensibly incorporate updates (quarterly updates of HES). A number of checks and tests were put in place to make sure The Health Foundation would be able to use consistent and sensible data for workstreams 1-4.
During 2020/21 analysis under Workstream 1 ‘Monitoring Trends’ was directed towards looking specifically at trends in demand for A&E services. This work analysed historical trends (workstream 1) and seasonal variation (workstream 2) of elective and emergency admissions, and outputs (tabulated data, with small numbers suppressed) from the data under this Agreement, were used to collaborate with Imperial College London to develop a modelling approach for optimal allocation of elective care capacity during the COVID-19 pandemic. The benefits from this modelling have helped the NHS policy makers make decisions regarding allocation of resources in order to reduce the waiting list of non-COVID related hospital treatments. The full benefits are yet to be realised as analysis is ongoing.
Objective for processing
The Health Foundation is an independent charity working to improve health and the quality of healthcare in the United Kingdom. As part of this strategy, the Health Foundation Data Analytics team analyses data on the quality of health and care.
The Health Foundation is the data controller and also processes the data for this study.
The Data Analytics team is requesting access to person-level data for an in-house programme of analyses to be completed over the course of the next 5 years.
The aim of this programme is to:
•produce new insights into quality of patient care,
•investigate how the quality of care can be improved
•understand the demand for health care in the UK using linked HES data and innovative analytical methods.
The overall purpose and benefit of this work is to inform the NHS and policy makers about changes in the characteristics and health needs of patients, factors that drive health care utilisation and health outcomes, and variation in health need, and quality of care. The work of The Health Foundation is designed to help the NHS understand the rising demand for health care and to plan for the future. The work packages within this programme will cover a number of thematic areas. These were identified as priorities for care quality and outcomes improvement in the recently published NHS Long Term Plan.
The Health Foundation are processing the data in line with their charitable goals as part of their legitimate interests. This is covered under the GDPR Article 6(1)(f) - This work is necessary for the purposes of the legitimate interests pursued by the controller or by a third party except where such interests are overridden by the interests or fundamental rights and freedoms of the data subject which require protection of personal data, in particular where the data subject is a child.
As set out in the legitimate interest assessment that The Health Foundation have undertaken - the data requested is to help achieve the following:
• To improve health service delivery (by evaluating policies and reporting feedback to the NHS and policy makers)
• To make health policy making more effective (the work packages look at specific policy implementation and how this has been effective and feedback will be given to policy makers)
• test innovations and spread what works
• build skills and knowledge (data access will help to evaluate and understand the rising demand for healthcare and plan for the future)
• develop and share evidence on what works and why (through conferences, presentations, and journal articles that will explain outcomes and results that have been generated using the NHS Digital Data.
The data is also required for service evaluation purposes - meeting the conditions outlined as per Article 9 (2)(I) of the GDPR. Processing is necessary for reasons of public interest in the area of public health, such as protecting against serious cross-border threats to health or ensuring high standards of quality and safety of health care and of medicinal products or medical devices, on the basis of Union or Member State law which provides for suitable and specific measures to safeguard the rights and freedoms of the data subject, in particular professional secrecy. The Health Foundation are carrying out service evaluation work as described in this agreement to investigate how the quality of care can be improved.
The overall purpose and benefit of this work is to inform the NHS and policy makers about changes in the characteristics and health needs of patients, factors that drive health care utilisation and health outcomes, and variation in health need, and quality of care. The work of The Health Foundation is designed to help the NHS understand the rising demand for health care and to plan for the future. The work packages within this programme will cover a number of thematic areas. These were identified as priorities for care quality and outcomes improvement in the recently published NHS Long Term Plan.
The Data Analytics team within The Health Foundation wish to undertake the following work streams:
Work stream 1: Monitoring trends
The Health Foundation will use patient-level data to summarise national contexts and to monitor local and national trends in secondary care in order to improve understanding of the drivers of demand and quality of patient care. Examples of trends that The Health Foundation wish to monitor include changes in disease (all diseases) prevalence and complexity over time, healthcare take-up and demand for distinct patient groups (e.g. patients with long-term conditions), as well as variations or changes in the characteristics of patients accessing secondary care. Key areas of focus within this theme will be:
• Multimorbidity: understanding the changing profiles and needs of patients with multiple long-term health conditions, following on from previous Health Foundation publications, which found that over half of hospital admissions and outpatient visits are for people living with 2 or more conditions. The Health Foundation aims to understand more about trends in combinations of conditions that patients present with in different parts of secondary care. Another goal of this workstream is to investigate the levels on under-recording of co-morbidities in electronic health records when they are not the primary reason for admission. This will be done by comparing HES-based prevalence estimates to estimates from other data sources, e.g. CPRD (Clinical Practice Research Datalink). The results from these analyses will help the NHS understand the rising demand for health care and to offer insight for policy makers and commissioners to design better quality patient care.
• Health and care inequality: unmet need and unexplained local variation in health care access and health outcomes. This analysis will help to raise awareness about existing and developing health inequalities and support the NHS and policy makers in finding solutions to address them.
• International comparison of quality metrics. Analysts at The Health Foundation will also analyse the data to provide aggregate statistics for international comparative analysis of health care quality, utilisation, cost and outcomes. This will be a contribution to an ongoing collaboration between the Health Foundation and partners from 11 other countries, including Germany, France, Australia and the USA. The aim is to compare how healthcare spending and demand for high-cost patients differs between countries. Understanding the differences between countries and their approaches will help to inform better management of these patient groups in the NHS. Note that for this project, only aggregate statistics with small numbers suppressed in line with NHS Digital guidance will be shared with colleagues overseas. These will be checked to ensure that no patient can be identified, and that the statistics contain no confidential information. No individual patient data will be shared. The collaborators do not have any influence on the means by which the data at the Health Foundation are being analysed.
• Patterns in healthcare demand and utilisation. Work will analyse the dataset to examine trends in demand for emergency and elective care over time and impact on patient outcomes (such as 30-day and 1-year mortality and 30-day readmission). This will also examine the impact of changing performance of hospital providers for example; changes to bed occupancy rates, A&E performance and waiting times.
Work-stream 1 will require linked patient-level Accident & Emergency/Emergency Care Data Set, Admitted Patient Care, Critical Care, Outpatient and Civil Registration Data for years 2008/2009 to current and future data up to 2023, for the whole population. To assess historical trends, access to a long time-series of data is required. To assess the health of children and young people, which is of particular interest in the mental health trends and examining trends in healthcare utilisation over time, a whole population sample is required. To assess outcomes, will need linked mortality data, including date of death to calculate 30-day all-cause mortality rates following a hospital admission.
Work stream 2: Seasonal variations
As part of the Health Foundation’s ongoing monitoring of winter pressures and the knock-on effect in care quality, analysts from the Data Analytics Team will investigate seasonal variations in A&E attendance and emergency admissions. This will include investigating patient profiles, including a focus on respiratory conditions due to their prevalence during the winter months, and a focus on long-stay patients.
The Health Foundation will undertake analyses that also aims to understand the consequences of winter pressures for other NHS services throughout the rest of the year, particularly on elective care such as outpatient appointments and elective hospital treatments. Key areas within this will be:
• Seasonal analysis of the volume of elective care and outpatient appointments with respect to geographical variation. This analysis will support policymakers and commissioners in planning for winter, as it will provide insight into areas that will require additional support.
• Cancellation of elective care in winter and their effect on demand and waiting times during other times of the year.
• Seasonal variation of length of stay for elective admissions and association with patient outcomes, such as emergency readmission and mortality.
This analysis will require linked patient-level inpatient and outpatient as well as mortality data, including date of death to calculate 30-day all-cause mortality rates following a hospital admission. This analysis will require data for years 2008/2009 to current and future data up to 2023, because it is important for this work to see whether changes in health service performance over time is affected by seasonal demand and variation. For example, were Health Foundation analysts to use the data from the recent years to see whether demand for health services increased in winter or summer, it would be useful to know whether these are recent phenomenon or whether such seasonal variations existed previously. This is important as The Health Foundation wouldn’t wish to make policy recommendations based on one-off ‘chance’ events, and therefore this justifies why it is necessary to look at seasonal variations within a fairly long-time frame - so that informed proposals can be made.
Work stream 3: Emergency hospital admissions and same-day emergency care
As part of the NHS Long Term Plan, NHS England is aiming to reduce pressure on emergency hospital services by reducing overall emergency admissions and by increasing the proportion of ‘zero-day admissions’ by providing Same Day Emergency Care (SDEC), which is also known as ambulatory emergency care.
The analysis for this workstream will investigate patient and provider characteristics associated with zero-day and 1+ day emergency admissions. Analysts will assess the effect on health outcomes, including 30-day readmission rates and mortality, compared to patients with longer hospital admissions. In addition, the effect of zero-day admissions at provider level will be analysed to explore geographical variation. This will be done using performance measures including A&E waiting times, inpatient bed days, bed occupancy, stranded patients and delayed transfers of care. This analysis will inform policymakers about progress in the implementation of the service changes set out in the NHS Long Term Plan and will provide insight into their effect on quality of patient care.
This analysis will require linked patient-level Accident & Emergency/Emergency Care Data Set, Admitted Patient Care, Critical Care, Outpatient for years 2008/2009 to current and future data up to 2023. so that progress of the implementation of this new care model can be monitored. The NHS Long-Term plan introduces a number of policy initiatives. In order to see how these initiatives will impact hospital emergency admissions, it is important to analyse emergency admissions data over time. For example, if between 2008 and 2018, The Health Foundation analyse a trend which then changes because of the implementation of a new policy, then the true effects of the policy can be determined. If The Health Foundation only used a short time period for analysis, then the significance of the impact of the change in policy would be more difficult to ascertain. Therefore, analysts require a fairly good run of years of data to be able to undertake a robust policy analysis.
Workstream 4: Outpatient care
Over the last decade the number of hospital outpatient appointments in England has almost doubled from 54 to 94 million yearly attendances. Outpatient care currently represents the largest proportion of NHS contact with patients in a hospital setting and accounts for around £8 billion in yearly healthcare expenditure.
The analysis for this workstream aims to provide new insight into quality of outpatient care by descriptively characterising outpatient journeys, focusing on patient characteristics and complexity, provider and appointment characteristics. Trends will be monitored over time, and an assessment of how these factors relate to case-mix in outpatient clinics and analyse geographical variation and variation associated with socioeconomic deprivation. This will provide commissioners, national and local healthcare leaders with better evidence on the patient need and current quality of outpatient care, in order to support them in finding solutions to meet these needs.
After a decade of substantial yearly growth, the number of outpatient appointments has remained constant since 2016/17. In the NHS Long Term Plan, this was attributed to the fact that GP referrals had been successfully constrained in recent years. The Health Foundation will dedicate part of the analysis to investigating the effect of this recent policy change by analysing the characteristics of patients that were not referred as a result and what the effect on outcomes was. This will include the effect on utilisation of other services as well as patient outcomes, such as emergency admissions and mortality.
One in five outpatient appointments in England are reported as cancelled by the patient or the hospital or as ‘did not attend’ (DNA). Missed or cancelled appointments have financial and operational implications for the NHS but can also have negative effects on quality of care and patient outcomes. This analysis will use patient-level data to investigate appointments that are frequently cancelled or missed, as well as geographical variation in cancellations and non-attendances and any links to socioeconomic deprivation. Included in this analysis will be an investigation as to whether the frequency of outpatient appointments, as well as the number of cancelled and missed appointments, is associated with patient outcomes, such as emergency re-admissions and mortality. This will also include comparisons between conventional and novel statistical approaches. This analysis will support policymakers and practitioners in understanding and avoiding non-attendances in outpatient care, which help to improve the efficiency of outpatient clinics and the quality of patient care.
This work stream will require linked patient-level inpatient and outpatient data, as well mortality data, including variables on date and cause of death.
As above, as the Health Foundation are (as part of this Work Stream) looking into policy change. A longer time span of data is required so that the full effect from the implementation of the policy can be analysed, so the true effects can be determined.
The Health Foundation wishes to process these data in order to describe and assess local and national trends in demand for secondary health care. This includes examining patterns and trends pertaining to individuals and their healthcare demands and take-up of healthcare services, in particular, those individuals with multiple health conditions, inequalities in healthcare demand. Furthermore, processing will be undertaken so that these trends can be compared with trends from other countries. In addition, data will be processed to examine seasonal variation in healthcare demand, the characteristics of patients demanding A&E services, and the demand for outpatient services.
By processing these data to generate these trends, The Health Foundation will be able to inform the health service about the situation of healthcare demand, take-up and treatment for the NHS in England. This will provide policymakers with a picture of the state of the health service demand, particularly for individuals with more than one health condition, as well as the extent to which inequalities exist. This information obtained from processing the data will provide the evidence-base for which policymakers can act to make improvements to patient healthcare. This fits with the remit of The Health Foundation, which is to bring about better health and healthcare for people living in the UK. This is essential work as demand for healthcare services continues to increase, due to an aging population, and healthcare providers continue to operate in a tight financial environment.
If the data were unavailable, The Health Foundation would not be able to undertake the work described above, and the benefits stated could not be realised. The Health Foundation has considered using aggregate sources of data for this work, but these have limitations: they have been created in a way which does not enable The Health Foundation to undertake the specific trends in healthcare that the organisation believe is important to contribute to public understanding about the health service.
In requesting to use the data, The Health Foundation will be complying with GDPR, in particular, that data will be used for a legitimate interest, and safeguards will protect the special categories of data used for this workstream.
As mentioned previously, processing the data will enable The Health Foundation to produce analysis relating to national trends of health service utilisation. Patient-level data are required to control for several characteristics to prevent biased statistical results from being produced. The Health Foundation seeks to avoid producing misleading analyses, and therefore it is important to use patient-level data to correctly build an accurate picture of healthcare demand and utilisation in England.
In doing so, The Health Foundation believes that the data processing is proportionate to the purpose for which it seeks to use data. There is a relatively low risk that patient data could be exposed, because of the security measures in place for protecting the data, and there is much benefit that will be realised from undertaking this analysis.
The data requested constitute special categories of data under the GDPR, since The Health Foundation has requested medical records pertaining to individuals, albeit in a pseudonymised format. Despite the fact that the data will be pseudonymised, the data may contain information about children and other vulnerable people owing to the fact that The Health Foundation has not restricted the data requested on the basis of age, disability etc. for the analysis. Trends pertaining to all patients and their use of the health service will be generated, although broken down by age group.
The Health Foundation is an independent charity that exists to further progress and improve the health care of the nation. As a charity independent of government funding, and any other interests, it endeavours to make the public aware that the use of patients’ data is solely for the purpose of improving the health service and treatments that patients receive.
There will be no impact on the data subjects (patients) whose data will be included in the extract received by The Health Foundation. Safeguards are in place to ensure that no individual data will be released from it’s accredited secure data environment in which the data will be processed; further checks will be applied to ensure that no statistical results published could reveal the identity, and/or confidential information, about any individual. Processing such data in a secure data environment is typical for organisations such as The Health Foundation, and guidance on security accreditation is sought and applied from a number of organisations including NHS Digital, Office for National Statistics, UK Data Service and HMRC (Her Majesty's Revenue and Customs) Data lab. Information about the use of patient data is available on The Health Foundation website.
Expected output
Statistical outputs produced from all projects listed previously will be assessed against best practice guidelines on statistical disclosure control and privacy protection to ensure the confidentiality of the data is maintained. All outputs will contain only data that is aggregated with small numbers suppressed in line with the HES Analysis Guide.
Several publications will be produced from each of the work streams listed under the Purpose section. These publications typically take the form of:
- Reports aimed at policy makers, disseminated through the Foundation’s website. The Health Foundation Communications Team advertises these reports through social media channels, and in addition, senior The Health Foundation staff highlight these reports to contacts throughout the health and social care system (such as at NHS England).
- Peer-reviewed journal articles
- Blogs on the Foundation’s website or others (e.g. Health Service Journal)
- Conferences and presentations
The Health Foundation’s approach to dissemination includes not only publications but also engagement with national policy makers, practitioners and researchers. The Health Foundation’s Communications team will lead on the dissemination of findings. The Health Foundation’s staff regularly speak to senior NHS leaders. For example, The Health Foundation’s report on multiple conditions (https://www.health.org.uk/publications/understanding-the-health-care-needs-of-people-with-multiple-health-conditions) featured in national media in Autumn 2018, in addition to staff at NHS England charged with designing and delivering national policy on integration and personalised care. Furthermore, The Health Foundation regularly liaises with local providers: for example, results of analysis into social isolation, were relayed to Barking and Dagenham in London. This instigated the establishment of a range of projects aimed to tackle social isolation across different age groups.
Wider dissemination of findings takes place via the media, and through social media and direct e-communication with key stakeholders. For example, a previous publication using HES data, on emergency admissions received extensive coverage in the trade media, support via social media from relevant royal colleges and other stakeholders, and exclusive national press coverage in The Times. Other publications from the team have received similar or greater coverage from media, and strong engagement on social media.
Planned publications:
• Health foundation briefing on trends in emergency admissions since the last Health Foundation analysis published in 2021
• Health Foundation briefing on the effects of implementation of same-day emergency care (planned for 2021, once data for the financial year 2019/20 is available)
• Health Foundation publication on elective care investigating seasonal demand and demand management practices 2021 and 2023.
• Health Foundation report on outpatient appointments
• Peer-reviewed publication(s) on outpatient journeys and the effect of missed/cancelled appointments to be published in BMJ, PloS Medicine, BMJ quality and safety or similar.
• Health Foundation publication on mental health (national trends analysis), 2021
• Peer-reviewed publication(s) on international comparisons of care quality to be published in BMJ, PloS Medicine, BMJ Quality and Safety or similar (ongoing 2021, 2022, 2023).
• Health Foundation publication on trends in care quality, and impact of major system changes, 2021 and 2023
Benefits reported
This Agreement mentions 4 Workstreams (1-4), and in addition, Workstream A in the Processing Activities section.
Workstream A is about cleaning and tidying up the data, making the data ready for analysis (for Workstreams 1-4). This is what The Health Foundation calls the HES Data Pipeline.
This work has been successfully completed. The work began when the data was originally received, and the Pipeline was completed in February 2020.
A large amount of work was undertaken to organise the data, clean, check for errors and quality issues, and could sensibly incorporate updates (quarterly updates of HES). A number of checks and tests were put in place to make sure The Health Foundation would be able to use consistent and sensible data for workstreams 1-4.
During 2020/21 analysis under Workstream 1 ‘Monitoring Trends’ was directed towards looking specifically at trends in demand for A&E services. This work analysed historical trends (workstream 1) and seasonal variation (workstream 2) of elective and emergency admissions, and outputs (tabulated data, with small numbers suppressed) from the data under this Agreement, were used to collaborate with Imperial College London to develop a modelling approach for optimal allocation of elective care capacity during the COVID-19 pandemic. The benefits from this modelling have helped the NHS policy makers make decisions regarding allocation of resources in order to reduce the waiting list of non-COVID related hospital treatments. The full benefits are yet to be realised as analysis is ongoing.
DARS-NIC-276970-B8Y4H-v1.2 26 September 2019 to 25 September 2022
- Title
- Monitoring the quality of healthcare in England
- Commercial
- No
- Sublicensing
- No
- Datasets
- 8
- Files released
- 120
Datasets: Civil Registrations of Death - Secondary Care Cut; HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES:Civil Registration (Deaths) bridge; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Critical Care (HES Critical Care); Hospital Episode Statistics Outpatients (HES OP)
What changed from DARS-NIC-276970-B8Y4H-v0.4
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2019-09-26 | |
| End date | 2022-09-25 |
Datasets: + HES-ID to MPS-ID HES Accident and Emergency; + HES-ID to MPS-ID HES Admitted Patient Care
Benefits reported
Stated in the previous version and removed here.
Yielded Benefits is not a requirement for new applications.
Unchanged: Objective for processing, Processing activities, Expected output, Expected measurable benefits.
Objective for processing
The Health Foundation is an independent charity working to improve health and the quality of health care in the United Kingdom. As part of this strategy, the Health Foundation Data Analytics team analyses data on the quality of health and care. The Health Foundation is the sole data controller and data processor of the data supplied by NHS Digital under this Agreement.
The Data Analytics team is requesting access to person-level data for an in-house programme of analyses to be completed over the course of the next 5 years.
The aim of this programme is to:
•produce new insights into quality of patient care,
•investigate how the quality of care can be improved
•understand the demand for health care in the UK using linked HES data and innovative analytical methods.
The overall purpose and benefit of this work is to inform the NHS and policy makers about changes in the characteristics and health needs of patients, factors that drive health care utilisation and health outcomes, and variation in health need, and quality of care. The work of The Health Foundation is designed to help the NHS understand the rising demand for health care and to plan for the future. The work packages within this programme will cover a number of thematic areas. These were identified as priorities for care quality and outcomes improvement in the recently published NHS Long Term Plan.
The Health Foundation are processing the data in line with their charitable goals as part of their legitimate interests. This is covered under the GDPR Article 6(1)(f) - This work is necessary for the purposes of the legitimate interests pursued by the controller or by a third party except where such interests are overridden by the interests or fundamental rights and freedoms of the data subject which require protection of personal data, in particular where the data subject is a child. As set out in the legitimate interest assessment that The Health Foundation have undertaken - the data requested is to help achieve the following:
• To improve health service delivery (by evaluating policies and reporting feedback to the NHS and policy makers)
• To make health policymaking more effective (the work packages look at specific policy implementation and how this has been effective and feedback will be given to policy makers)
• test innovations and spread what works
• build skills and knowledge (data access will help to evaluate and understand the rising demand for healthcare and plan for the future)
• develop and share evidence on what works and why (through conferences, presentations, and journal articles that will explain outcomes and results that have been generated using the NHS Digital Data.
The data is also required for service evaluation purposes - meeting the conditions outlined as per Article 9 (2)(I) of the GDPR. Processing is necessary for reasons of public interest in the area of public health, such as protecting against serious cross-border threats to health or ensuring high standards of quality and safety of health care and of medicinal products or medical devices, on the basis of Union or Member State law which provides for suitable and specific measures to safeguard the rights and freedoms of the data subject, in particular professional secrecy. The Health Foundation are carrying out service evaluation work as described in this agreement to investigate how the quality of care can be improved.
The overall purpose and benefit of this work is to inform the NHS and policy makers about changes in the characteristics and health needs of patients, factors that drive health care utilisation and health outcomes, and variation in health need, and quality of care. The work of The Health Foundation is designed to help the NHS understand the rising demand for health care and to plan for the future. The work packages within this programme will cover a number of thematic areas. These were identified as priorities for care quality and outcomes improvement in the recently published NHS Long Term Plan.
How will The Health Foundation achieve this work?
The Data Analytics team within The Health Foundation wish to undertake the following work streams:
Work stream 1: Monitoring trends
The Health Foundation will use patient-level data to summarise national contexts and to monitor local and national trends in secondary care in order to improve understanding of the drivers of demand and quality of patient care. Examples of trends that The Health Foundation wish to monitor include changes in disease (all diseases) prevalence and complexity over time, healthcare take-up and demand for distinct patient groups (e.g. patients with long-term conditions), as well as variations or changes in the characteristics of patients accessing secondary care. Key areas of focus within this theme will be:
• Multimorbidity: understanding the changing profiles and needs of patients with multiple long-term health conditions, following on from previous Health Foundation publications, which found that over half of hospital admissions and outpatient visits are for people living with 2 or more conditions. The Health Foundation aims to understand more about trends in combinations of conditions that patients present with in different parts of secondary care. Another goal of this workstream is to investigate the levels on under-recording of co-morbidities in electronic health records when they are not the primary reason for admission. This will be done by comparing HES-based prevalence estimates to estimates from other data sources, e.g. CPRD (Clinical Practice Research Datalink). The results from these analyses will help the NHS understand the rising demand for health care and to offer insight for policy makers and commissioners to design better quality patient care.
• Health and care inequality: unmet need and unexplained local variation in health care access and health outcomes. This analysis will help to raise awareness about existing and developing health inequalities and support the NHS and policy makers in finding solutions to address them.
• International comparison of quality metrics. Analysts at The Health Foundation will also analyse the data to provide aggregate statistics for international comparative analysis of health care quality, utilisation, cost and outcomes. This will be a contribution to an ongoing collaboration between the Health Foundation and partners from 11 other countries, including Germany, France, Australia and the USA. The aim is to compare how healthcare spending and demand for high-cost patients differs between countries. Understanding the differences between countries and their approaches will help to inform better management of these patient groups in the NHS. Note that for this project, only aggregate statistics with small numbers suppressed in line with NHS Digital guidance will be shared with colleagues overseas. These will be checked to ensure that no patient can be identified, and that the statistics contain no confidential information. No individual patient data will be shared. The collaborators do not have any influence on the means by which the data at the Health Foundation are being analysed.
• Patterns in healthcare demand and utilisation. Work will analyse the dataset to examine trends in demand for emergency and elective care over time and impact on patient outcomes (such as 30-day and 1-year mortality and 30-day readmission). This will also examine the impact of changing performance of hospital providers for example; changes to bed occupancy rates, A&E performance and waiting times.
Work-stream 1 will require linked patient-level A&E, inpatient, critical care, outpatient and mortality data for the last 10 years (2008/2009 to 2018/2019) for the whole population. To assess historical trends, access to a long time-series of data is required. To assess the health of children and young people, which is of particular interest in the mental health trends and examining trends in healthcare utilisation over time, a whole population sample is required. To assess outcomes, will need linked mortality data, including date of death to calculate 30-day all-cause mortality rates following a hospital admission.
Work stream 2: Seasonal variations
As part of the Health Foundation’s ongoing monitoring of winter pressures and the knock-on effect in care quality, analysts from the Data Analytics Team will investigate seasonal variations in A&E attendance and emergency admissions. This will include investigating patient profiles, including a focus on respiratory conditions due to their prevalence during the winter months, and a focus on long-stay patients.
The Health Foundation will undertake analyses that also aims to understand the consequences of winter pressures for other NHS services throughout the rest of the year, particularly on elective care such as outpatient appointments and elective hospital treatments. Key areas within this will be:
• Seasonal analysis of the volume of elective care and outpatient appointments with respect to geographical variation. This analysis will support policymakers and commissioners in planning for winter, as it will provide insight into areas that will require additional support.
• Cancellation of elective care in winter and their effect on demand and waiting times during other times of the year.
• Seasonal variation of length of stay for elective admissions and association with patient outcomes, such as emergency readmission and mortality.
This analysis will require linked patient-level inpatient and outpatient as well as mortality data, including date of death to calculate 30-day all-cause mortality rates following a hospital admission. This analysis will require data from the last 10 years, because it is important for this work to see whether changes in health service performance over time is affected by seasonal demand and variation. For example, were Health Foundation analysts to use the data from the recent years to see whether demand for health services increased in winter or summer, it would be useful to know whether these are recent phenomenon or whether such seasonal variations existed previously. This is important as The Health Foundation wouldn’t wish to make policy recommendations based on one-off ‘chance’ events, and therefore this justifies why it is necessary to look at seasonal variations within a fairly long-time frame - so that informed proposals can be made.
Work stream 3: Emergency hospital admissions and same-day emergency care
As part of the NHS Long Term Plan, NHS England is aiming to reduce pressure on emergency hospital services by reducing overall emergency admissions and by increasing the proportion of ‘zero-day admissions’ by providing Same Day Emergency Care (SDEC), which is also known as ambulatory emergency care.
The analysis for this workstream will investigate patient and provider characteristics associated with zero-day and 1+ day emergency admissions. Analysts will assess the effect on health outcomes, including 30-day readmission rates and mortality, compared to patients with longer hospital admissions. In addition, the effect of zero-day admissions at provider level will be analysed to explore geographical variation. This will be done using performance measures including A&E waiting times, inpatient bed days, bed occupancy, stranded patients and delayed transfers of care. This analysis will inform policymakers about progress in the implementation of the service changes set out in the NHS Long Term Plan and will provide insight into their effect on quality of patient care.
This analysis will require linked A&E, critical care and inpatient data with quarterly data updates when new data becomes available, so that progress of the implementation of this new care model can be monitored. The NHS Long-Term plan introduces a number of policy initiatives. In order to see how these initiatives will impact hospital emergency admissions, it is important to analyse emergency admissions data over time. For example, if between 2008 and 2018, The Health Foundation analyse a trend which then changes because of the implementation of a new policy, then the true effects of the policy can be determined. If The Health Foundation only used a short time period for analysis, then the significance of the impact of the change in policy would be more difficult to ascertain. Therefore, analysts require a fairly good run of years of data to be able to undertake a robust policy analysis.
Workstream 4: Outpatient care
Over the last decade the number of hospital outpatient appointments in England has almost doubled from 54 to 94 million yearly attendances. Outpatient care currently represents the largest proportion of NHS contact with patients in a hospital setting and accounts for around £8 billion in yearly healthcare expenditure.
The analysis for this workstream aims to provide new insight into quality of outpatient care by descriptively characterising outpatient journeys, focusing on patient characteristics and complexity, provider and appointment characteristics. Trends will be monitored over time, and an assessment of how these factors relate to case-mix in outpatient clinics and analyse geographical variation and variation associated with socioeconomic deprivation. This will provide commissioners, national and local healthcare leaders with better evidence on the patient need and current quality of outpatient care, in order to support them in finding solutions to meet these needs.
After a decade of substantial yearly growth, the number of outpatient appointments has remained constant since 2016/17. In the NHS Long Term Plan, this was attributed to the fact that GP referrals had been successfully constrained in recent years. The Health Foundation will dedicate part of the analysis to investigating the effect of this recent policy change by analysing the characteristics of patients that were not referred as a result and what the effect on outcomes was. This will include the effect on utilisation of other services as well as patient outcomes, such as emergency admissions and mortality.
One in five outpatient appointments in England are reported as cancelled by the patient or the hospital or as ‘did not attend’ (DNA). Missed or cancelled appointments have financial and operational implications for the NHS but can also have negative effects on quality of care and patient outcomes. This analysis will use patient-level data to investigate appointments that are frequently cancelled or missed, as well as geographical variation in cancellations and non-attendances and any links to socioeconomic deprivation. Included in this analysis will be an investigation as to whether the frequency of outpatient appointments, as well as the number of cancelled and missed appointments, is associated with patient outcomes, such as emergency re-admissions and mortality. This will also include comparisons between conventional and novel statistical approaches. This analysis will support policymakers and practitioners in understanding and avoiding non-attendances in outpatient care, which help to improve the efficiency of outpatient clinics and the quality of patient care.
This work stream will require linked patient-level inpatient and outpatient data, as well mortality data, including variables on date and cause of death.
As above, as the Health Foundation are (as part of this Work Stream) looking into policy change. A longer time span of data is required so that the full effect from the implentation of the policy can be analysed, so the true effects can be determined.
The Health Foundation wishes to process these data in order to describe and assess local and national trends in demand for secondary health care. This includes examining patterns and trends pertaining to individuals and their healthcare demands and take-up of healthcare services, in particular, those individuals with multiple health conditions; inequalities in healthcare demand. Furthermore, processing will be undertaken so that these trends can be compared with trends from other countries. In addition, data will be processed to examine seasonal variation in healthcare demand, the characteristics of patients demanding A&E services, and the demand for outpatient services.
By processing these data to generate these trends, The Health Foundation will be able to inform the health service about the situation of healthcare demand, take-up and treatment for the NHS in England. This will provide policymakers with a picture of the state of the health service demand, particularly for individuals with more than one health condition, as well as the extent to which inequalities exist. This information obtained from processing the data will provide the evidence-base for which policymakers can act to make improvements to patient healthcare. This fits with the remit of The Health Foundation, which is to bring about better health and healthcare for people living in the UK. This is essential work as demand for healthcare services continues to increase, due to an aging population, and healthcare providers continue to operate in a tight financial environment.
The Health Foundation will undertake this work by itself, and this will not involve participation of third parties.
If these data were unavailable, then The Health Foundation wouldn’t be able to undertake the work described above, and the benefits stated could not be realised. The Health Foundation has considered using aggregate sources of data for this work, but these have limitations: they have been created in a way which does not enable The Health Foundation to undertake the specific trends in healthcare that the organisation believe is important to contribute to public understanding about the health service.
In requesting to use these data, The Health Foundation will be complying with GDPR, in particular, that data will be used for a legitimate interest, and safeguards will protect the special categories of data used for this workstream.
As mentioned previously, processing the data will enable The Health Foundation to produce analysis relating to national trends of health service utilisation. Patient-level data are required to control for a number of characteristics to prevent biased statistical results from being produced. The Health Foundation seeks to avoid producing misleading analyses, and therefore it is important to use patient-level data to correctly build an accurate picture of healthcare demand and utilisation in England.
In doing so, The Health Foundation believes that the data processing is proportionate to the purpose for which it seeks to use data. There is a relatively low risk that patient data could be exposed, because of the security measures in place for protecting the data, and there is much benefit that will be realised from undertaking this analysis.
The data requested constitute special categories of data under the GDPR, since The Health Foundation has requested medical records pertaining to individuals, albeit in a pseudonymised format. Despite the fact that the data will be pseudonymised, the data may contain information about children and other vulnerable people owing to the fact that The Health Foundation has not restricted the data requested on the basis of age, disability etc. for the analysis. Trends pertaining to all patients and their use of the health service will be generated, although broken down by age group.
The Health Foundation is an independent charity that exists to further progress and improve the health care of the nation. As a charity independent of government funding , and any other interests, it endeavors to make the public aware that the use of patients’ data is solely for the purpose of improving the health service and treatments that patients receive.
There will be no impact on the data subjects (patients) whose data will be included in the extract received by The Health Foundation. Safeguards are in place to ensure that no individual data will be released from it’s accredited secure data environment in which the data will be processed; further checks will be applied to ensure that no statistical results published could reveal the identity, and/or confidential information, about any individual. Processing such data in a secure data environment is typical for organisations such as The Health Foundation, and guidance on security accreditation is sought and applied from a number of organisations including NHS Digital, Office for National Statistics, UK Data Service and HMRC (Her Majesty's Revenue and Customs) Datalab. Information about the use of patient data is available on The Health Foundation website.
Expected output
Statistical outputs produced from all projects listed previously will be assessed against best practice guidelines on statistical disclosure control and privacy protection to ensure the confidentiality of the data is maintained. All outputs will contain only data that is aggregated with small numbers suppressed in line with the HES Analysis Guide.
Several publications will be produced from each of the work streams listed under the Purpose section. These publications typically take the form of:
- Reports aimed at policy makers, disseminated through the Foundation’s website. The Health Foundation Communications Team advertises these reports through social media channels, and in addition, senior The Health Foundation staff highlight these reports to contacts throughout the health and social care system (such as at NHS England).
- Peer-reviewed journal articles
- Blogs on the Foundation’s website or others (e.g. Health Service Journal)
- Conferences and presentations
The Health Foundation’s approach to dissemination includes not only publications but also engagement with national policy makers, practitioners and researchers. The Health Foundation’s Communications team will lead on the dissemination of findings. The Health Foundation’s staff regularly speak to senior NHS leaders. For example, The Health Foundation’s report on multiple conditions (https://www.health.org.uk/publications/understanding-the-health-care-needs-of-people-with-multiple-health-conditions) featured in national media in Autumn 2018, in addition to staff at NHS England charged with designing and delivering national policy on integration and personalised care. Furthermore, The Health Foundation regularly liaises with local providers: for example, results of analysis into social isolation, were relayed to Barking and Dagenham in London. This instigated the establishment of a range of projects aimed to tackle social isolation across different age groups.
Wider dissemination of findings takes place via the media, and through social media and direct e-communication with key stakeholders. For example, a previous publication using HES data, on emergency admissions received extensive coverage in the trade media, support via social media from relevant royal colleges and other stakeholders, and exclusive national press coverage in The Times. Other publications from the team have received similar or greater coverage from media, and strong engagement on social media.
Planned publications:
• Health foundation briefing on trends in emergency admissions since the last Health Foundation analysis published in 2018, 2021
• Health Foundation briefing on the effects of implementation of same-day emergency care (planned for 2021, once data for the financial year 2019/20 is available)
• Health Foundation publication on elective care investigating seasonal demand and demand management practices 2021 and 2023.
• Health Foundation report on outpatient appointments, 2019
• Peer-reviewed publication(s) on outpatient journeys and the effect of missed/cancelled appointments to be published in BMJ, PloS Medicine, BMJ quality and safety or similar.
• Health Foundation publication on mental health (national trends analysis), 2019 and 2021
• Peer-reviewed publication(s) on international comparisons of care quality to be published in BMJ, PloS Medicine, BMJ Quality and Safety or similar (ongoing 2021, 2022, 2023).
• Health Foundation publication on health and care inequalities, 2020
• Health Foundation publication on trends in care quality, and impact of major system changes, 2021 and 2023
DARS-NIC-276970-B8Y4H-v0.4 30 August 2019 to 29 August 2022
- Title
- Monitoring the quality of healthcare in England
- Commercial
- No
- Sublicensing
- No
- Datasets
- 6
- Files released
- 0
Datasets: Civil Registrations of Death - Secondary Care Cut; HES:Civil Registration (Deaths) bridge; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Critical Care (HES Critical Care); Hospital Episode Statistics Outpatients (HES OP)
Objective for processing
The Health Foundation is an independent charity working to improve health and the quality of health care in the United Kingdom. As part of this strategy, the Health Foundation Data Analytics team analyses data on the quality of health and care. The Health Foundation is the sole data controller and data processor of the data supplied by NHS Digital under this Agreement.
The Data Analytics team is requesting access to person-level data for an in-house programme of analyses to be completed over the course of the next 5 years.
The aim of this programme is to:
•produce new insights into quality of patient care,
•investigate how the quality of care can be improved
•understand the demand for health care in the UK using linked HES data and innovative analytical methods.
The overall purpose and benefit of this work is to inform the NHS and policy makers about changes in the characteristics and health needs of patients, factors that drive health care utilisation and health outcomes, and variation in health need, and quality of care. The work of The Health Foundation is designed to help the NHS understand the rising demand for health care and to plan for the future. The work packages within this programme will cover a number of thematic areas. These were identified as priorities for care quality and outcomes improvement in the recently published NHS Long Term Plan.
The Health Foundation are processing the data in line with their charitable goals as part of their legitimate interests. This is covered under the GDPR Article 6(1)(f) - This work is necessary for the purposes of the legitimate interests pursued by the controller or by a third party except where such interests are overridden by the interests or fundamental rights and freedoms of the data subject which require protection of personal data, in particular where the data subject is a child. As set out in the legitimate interest assessment that The Health Foundation have undertaken - the data requested is to help achieve the following:
• To improve health service delivery (by evaluating policies and reporting feedback to the NHS and policy makers)
• To make health policymaking more effective (the work packages look at specific policy implementation and how this has been effective and feedback will be given to policy makers)
• test innovations and spread what works
• build skills and knowledge (data access will help to evaluate and understand the rising demand for healthcare and plan for the future)
• develop and share evidence on what works and why (through conferences, presentations, and journal articles that will explain outcomes and results that have been generated using the NHS Digital Data.
The data is also required for service evaluation purposes - meeting the conditions outlined as per Article 9 (2)(I) of the GDPR. Processing is necessary for reasons of public interest in the area of public health, such as protecting against serious cross-border threats to health or ensuring high standards of quality and safety of health care and of medicinal products or medical devices, on the basis of Union or Member State law which provides for suitable and specific measures to safeguard the rights and freedoms of the data subject, in particular professional secrecy. The Health Foundation are carrying out service evaluation work as described in this agreement to investigate how the quality of care can be improved.
The overall purpose and benefit of this work is to inform the NHS and policy makers about changes in the characteristics and health needs of patients, factors that drive health care utilisation and health outcomes, and variation in health need, and quality of care. The work of The Health Foundation is designed to help the NHS understand the rising demand for health care and to plan for the future. The work packages within this programme will cover a number of thematic areas. These were identified as priorities for care quality and outcomes improvement in the recently published NHS Long Term Plan.
How will The Health Foundation achieve this work?
The Data Analytics team within The Health Foundation wish to undertake the following work streams:
Work stream 1: Monitoring trends
The Health Foundation will use patient-level data to summarise national contexts and to monitor local and national trends in secondary care in order to improve understanding of the drivers of demand and quality of patient care. Examples of trends that The Health Foundation wish to monitor include changes in disease (all diseases) prevalence and complexity over time, healthcare take-up and demand for distinct patient groups (e.g. patients with long-term conditions), as well as variations or changes in the characteristics of patients accessing secondary care. Key areas of focus within this theme will be:
• Multimorbidity: understanding the changing profiles and needs of patients with multiple long-term health conditions, following on from previous Health Foundation publications, which found that over half of hospital admissions and outpatient visits are for people living with 2 or more conditions. The Health Foundation aims to understand more about trends in combinations of conditions that patients present with in different parts of secondary care. Another goal of this workstream is to investigate the levels on under-recording of co-morbidities in electronic health records when they are not the primary reason for admission. This will be done by comparing HES-based prevalence estimates to estimates from other data sources, e.g. CPRD (Clinical Practice Research Datalink). The results from these analyses will help the NHS understand the rising demand for health care and to offer insight for policy makers and commissioners to design better quality patient care.
• Health and care inequality: unmet need and unexplained local variation in health care access and health outcomes. This analysis will help to raise awareness about existing and developing health inequalities and support the NHS and policy makers in finding solutions to address them.
• International comparison of quality metrics. Analysts at The Health Foundation will also analyse the data to provide aggregate statistics for international comparative analysis of health care quality, utilisation, cost and outcomes. This will be a contribution to an ongoing collaboration between the Health Foundation and partners from 11 other countries, including Germany, France, Australia and the USA. The aim is to compare how healthcare spending and demand for high-cost patients differs between countries. Understanding the differences between countries and their approaches will help to inform better management of these patient groups in the NHS. Note that for this project, only aggregate statistics with small numbers suppressed in line with NHS Digital guidance will be shared with colleagues overseas. These will be checked to ensure that no patient can be identified, and that the statistics contain no confidential information. No individual patient data will be shared. The collaborators do not have any influence on the means by which the data at the Health Foundation are being analysed.
• Patterns in healthcare demand and utilisation. Work will analyse the dataset to examine trends in demand for emergency and elective care over time and impact on patient outcomes (such as 30-day and 1-year mortality and 30-day readmission). This will also examine the impact of changing performance of hospital providers for example; changes to bed occupancy rates, A&E performance and waiting times.
Work-stream 1 will require linked patient-level A&E, inpatient, critical care, outpatient and mortality data for the last 10 years (2008/2009 to 2018/2019) for the whole population. To assess historical trends, access to a long time-series of data is required. To assess the health of children and young people, which is of particular interest in the mental health trends and examining trends in healthcare utilisation over time, a whole population sample is required. To assess outcomes, will need linked mortality data, including date of death to calculate 30-day all-cause mortality rates following a hospital admission.
Work stream 2: Seasonal variations
As part of the Health Foundation’s ongoing monitoring of winter pressures and the knock-on effect in care quality, analysts from the Data Analytics Team will investigate seasonal variations in A&E attendance and emergency admissions. This will include investigating patient profiles, including a focus on respiratory conditions due to their prevalence during the winter months, and a focus on long-stay patients.
The Health Foundation will undertake analyses that also aims to understand the consequences of winter pressures for other NHS services throughout the rest of the year, particularly on elective care such as outpatient appointments and elective hospital treatments. Key areas within this will be:
• Seasonal analysis of the volume of elective care and outpatient appointments with respect to geographical variation. This analysis will support policymakers and commissioners in planning for winter, as it will provide insight into areas that will require additional support.
• Cancellation of elective care in winter and their effect on demand and waiting times during other times of the year.
• Seasonal variation of length of stay for elective admissions and association with patient outcomes, such as emergency readmission and mortality.
This analysis will require linked patient-level inpatient and outpatient as well as mortality data, including date of death to calculate 30-day all-cause mortality rates following a hospital admission. This analysis will require data from the last 10 years, because it is important for this work to see whether changes in health service performance over time is affected by seasonal demand and variation. For example, were Health Foundation analysts to use the data from the recent years to see whether demand for health services increased in winter or summer, it would be useful to know whether these are recent phenomenon or whether such seasonal variations existed previously. This is important as The Health Foundation wouldn’t wish to make policy recommendations based on one-off ‘chance’ events, and therefore this justifies why it is necessary to look at seasonal variations within a fairly long-time frame - so that informed proposals can be made.
Work stream 3: Emergency hospital admissions and same-day emergency care
As part of the NHS Long Term Plan, NHS England is aiming to reduce pressure on emergency hospital services by reducing overall emergency admissions and by increasing the proportion of ‘zero-day admissions’ by providing Same Day Emergency Care (SDEC), which is also known as ambulatory emergency care.
The analysis for this workstream will investigate patient and provider characteristics associated with zero-day and 1+ day emergency admissions. Analysts will assess the effect on health outcomes, including 30-day readmission rates and mortality, compared to patients with longer hospital admissions. In addition, the effect of zero-day admissions at provider level will be analysed to explore geographical variation. This will be done using performance measures including A&E waiting times, inpatient bed days, bed occupancy, stranded patients and delayed transfers of care. This analysis will inform policymakers about progress in the implementation of the service changes set out in the NHS Long Term Plan and will provide insight into their effect on quality of patient care.
This analysis will require linked A&E, critical care and inpatient data with quarterly data updates when new data becomes available, so that progress of the implementation of this new care model can be monitored. The NHS Long-Term plan introduces a number of policy initiatives. In order to see how these initiatives will impact hospital emergency admissions, it is important to analyse emergency admissions data over time. For example, if between 2008 and 2018, The Health Foundation analyse a trend which then changes because of the implementation of a new policy, then the true effects of the policy can be determined. If The Health Foundation only used a short time period for analysis, then the significance of the impact of the change in policy would be more difficult to ascertain. Therefore, analysts require a fairly good run of years of data to be able to undertake a robust policy analysis.
Workstream 4: Outpatient care
Over the last decade the number of hospital outpatient appointments in England has almost doubled from 54 to 94 million yearly attendances. Outpatient care currently represents the largest proportion of NHS contact with patients in a hospital setting and accounts for around £8 billion in yearly healthcare expenditure.
The analysis for this workstream aims to provide new insight into quality of outpatient care by descriptively characterising outpatient journeys, focusing on patient characteristics and complexity, provider and appointment characteristics. Trends will be monitored over time, and an assessment of how these factors relate to case-mix in outpatient clinics and analyse geographical variation and variation associated with socioeconomic deprivation. This will provide commissioners, national and local healthcare leaders with better evidence on the patient need and current quality of outpatient care, in order to support them in finding solutions to meet these needs.
After a decade of substantial yearly growth, the number of outpatient appointments has remained constant since 2016/17. In the NHS Long Term Plan, this was attributed to the fact that GP referrals had been successfully constrained in recent years. The Health Foundation will dedicate part of the analysis to investigating the effect of this recent policy change by analysing the characteristics of patients that were not referred as a result and what the effect on outcomes was. This will include the effect on utilisation of other services as well as patient outcomes, such as emergency admissions and mortality.
One in five outpatient appointments in England are reported as cancelled by the patient or the hospital or as ‘did not attend’ (DNA). Missed or cancelled appointments have financial and operational implications for the NHS but can also have negative effects on quality of care and patient outcomes. This analysis will use patient-level data to investigate appointments that are frequently cancelled or missed, as well as geographical variation in cancellations and non-attendances and any links to socioeconomic deprivation. Included in this analysis will be an investigation as to whether the frequency of outpatient appointments, as well as the number of cancelled and missed appointments, is associated with patient outcomes, such as emergency re-admissions and mortality. This will also include comparisons between conventional and novel statistical approaches. This analysis will support policymakers and practitioners in understanding and avoiding non-attendances in outpatient care, which help to improve the efficiency of outpatient clinics and the quality of patient care.
This work stream will require linked patient-level inpatient and outpatient data, as well mortality data, including variables on date and cause of death.
As above, as the Health Foundation are (as part of this Work Stream) looking into policy change. A longer time span of data is required so that the full effect from the implentation of the policy can be analysed, so the true effects can be determined.
The Health Foundation wishes to process these data in order to describe and assess local and national trends in demand for secondary health care. This includes examining patterns and trends pertaining to individuals and their healthcare demands and take-up of healthcare services, in particular, those individuals with multiple health conditions; inequalities in healthcare demand. Furthermore, processing will be undertaken so that these trends can be compared with trends from other countries. In addition, data will be processed to examine seasonal variation in healthcare demand, the characteristics of patients demanding A&E services, and the demand for outpatient services.
By processing these data to generate these trends, The Health Foundation will be able to inform the health service about the situation of healthcare demand, take-up and treatment for the NHS in England. This will provide policymakers with a picture of the state of the health service demand, particularly for individuals with more than one health condition, as well as the extent to which inequalities exist. This information obtained from processing the data will provide the evidence-base for which policymakers can act to make improvements to patient healthcare. This fits with the remit of The Health Foundation, which is to bring about better health and healthcare for people living in the UK. This is essential work as demand for healthcare services continues to increase, due to an aging population, and healthcare providers continue to operate in a tight financial environment.
The Health Foundation will undertake this work by itself, and this will not involve participation of third parties.
If these data were unavailable, then The Health Foundation wouldn’t be able to undertake the work described above, and the benefits stated could not be realised. The Health Foundation has considered using aggregate sources of data for this work, but these have limitations: they have been created in a way which does not enable The Health Foundation to undertake the specific trends in healthcare that the organisation believe is important to contribute to public understanding about the health service.
In requesting to use these data, The Health Foundation will be complying with GDPR, in particular, that data will be used for a legitimate interest, and safeguards will protect the special categories of data used for this workstream.
As mentioned previously, processing the data will enable The Health Foundation to produce analysis relating to national trends of health service utilisation. Patient-level data are required to control for a number of characteristics to prevent biased statistical results from being produced. The Health Foundation seeks to avoid producing misleading analyses, and therefore it is important to use patient-level data to correctly build an accurate picture of healthcare demand and utilisation in England.
In doing so, The Health Foundation believes that the data processing is proportionate to the purpose for which it seeks to use data. There is a relatively low risk that patient data could be exposed, because of the security measures in place for protecting the data, and there is much benefit that will be realised from undertaking this analysis.
The data requested constitute special categories of data under the GDPR, since The Health Foundation has requested medical records pertaining to individuals, albeit in a pseudonymised format. Despite the fact that the data will be pseudonymised, the data may contain information about children and other vulnerable people owing to the fact that The Health Foundation has not restricted the data requested on the basis of age, disability etc. for the analysis. Trends pertaining to all patients and their use of the health service will be generated, although broken down by age group.
The Health Foundation is an independent charity that exists to further progress and improve the health care of the nation. As a charity independent of government funding , and any other interests, it endeavors to make the public aware that the use of patients’ data is solely for the purpose of improving the health service and treatments that patients receive.
There will be no impact on the data subjects (patients) whose data will be included in the extract received by The Health Foundation. Safeguards are in place to ensure that no individual data will be released from it’s accredited secure data environment in which the data will be processed; further checks will be applied to ensure that no statistical results published could reveal the identity, and/or confidential information, about any individual. Processing such data in a secure data environment is typical for organisations such as The Health Foundation, and guidance on security accreditation is sought and applied from a number of organisations including NHS Digital, Office for National Statistics, UK Data Service and HMRC (Her Majesty's Revenue and Customs) Datalab. Information about the use of patient data is available on The Health Foundation website.
Expected output
Statistical outputs produced from all projects listed previously will be assessed against best practice guidelines on statistical disclosure control and privacy protection to ensure the confidentiality of the data is maintained. All outputs will contain only data that is aggregated with small numbers suppressed in line with the HES Analysis Guide.
Several publications will be produced from each of the work streams listed under the Purpose section. These publications typically take the form of:
- Reports aimed at policy makers, disseminated through the Foundation’s website. The Health Foundation Communications Team advertises these reports through social media channels, and in addition, senior The Health Foundation staff highlight these reports to contacts throughout the health and social care system (such as at NHS England).
- Peer-reviewed journal articles
- Blogs on the Foundation’s website or others (e.g. Health Service Journal)
- Conferences and presentations
The Health Foundation’s approach to dissemination includes not only publications but also engagement with national policy makers, practitioners and researchers. The Health Foundation’s Communications team will lead on the dissemination of findings. The Health Foundation’s staff regularly speak to senior NHS leaders. For example, The Health Foundation’s report on multiple conditions (https://www.health.org.uk/publications/understanding-the-health-care-needs-of-people-with-multiple-health-conditions) featured in national media in Autumn 2018, in addition to staff at NHS England charged with designing and delivering national policy on integration and personalised care. Furthermore, The Health Foundation regularly liaises with local providers: for example, results of analysis into social isolation, were relayed to Barking and Dagenham in London. This instigated the establishment of a range of projects aimed to tackle social isolation across different age groups.
Wider dissemination of findings takes place via the media, and through social media and direct e-communication with key stakeholders. For example, a previous publication using HES data, on emergency admissions received extensive coverage in the trade media, support via social media from relevant royal colleges and other stakeholders, and exclusive national press coverage in The Times. Other publications from the team have received similar or greater coverage from media, and strong engagement on social media.
Planned publications:
• Health foundation briefing on trends in emergency admissions since the last Health Foundation analysis published in 2018, 2021
• Health Foundation briefing on the effects of implementation of same-day emergency care (planned for 2021, once data for the financial year 2019/20 is available)
• Health Foundation publication on elective care investigating seasonal demand and demand management practices 2021 and 2023.
• Health Foundation report on outpatient appointments, 2019
• Peer-reviewed publication(s) on outpatient journeys and the effect of missed/cancelled appointments to be published in BMJ, PloS Medicine, BMJ quality and safety or similar.
• Health Foundation publication on mental health (national trends analysis), 2019 and 2021
• Peer-reviewed publication(s) on international comparisons of care quality to be published in BMJ, PloS Medicine, BMJ Quality and Safety or similar (ongoing 2021, 2022, 2023).
• Health Foundation publication on health and care inequalities, 2020
• Health Foundation publication on trends in care quality, and impact of major system changes, 2021 and 2023
Benefits reported
Yielded Benefits is not a requirement for new applications.
Register history
When this agreement appeared in, or was edited in, each monthly edition of the register. Built by comparing every edition this site holds, the earliest of which is July 2021.
-
July 2021 —
already listed in the earliest edition this site holds, so it may be older. 2 versions: DARS-NIC-276970-B8Y4H-v0.4, DARS-NIC-276970-B8Y4H-v1.2
-
October 2021
Amended DARS-NIC-276970-B8Y4H-v1.2
- Datasets: + HES-ID to MPS-ID HES Accident and Emergency; + HES-ID to MPS-ID HES Admitted Patient Care
-
April 2022
1 version added: DARS-NIC-276970-B8Y4H-v2.12
-
December 2022
Register-wide edit DARS-NIC-276970-B8Y4H-v0.4, DARS-NIC-276970-B8Y4H-v1.2 — Datasets: legal basis: “
s261(1) and” taken out. Made to 639 agreements in this edition, so it is reported once, on the changes page, and not counted as an amendment of this agreement. -
April 2025
1 version added: DARS-NIC-276970-B8Y4H-v3.4
-
September 2026
1 version added: DARS-NIC-276970-B8Y4H-v4.3
"Amended in place" means NHS England changed the record without issuing a new version number. The register publishes no changelog for those edits; this site infers them by comparing editions. An edit is attributed to the edition it first appears in, not to the date it was made.
Cite this page
NHS England (2026) Data Uses Register, September 2026 edition, agreement DARS-NIC-276970-B8Y4H, “Monitoring the quality of healthcare in England”. Read via NHS Data Access Explorer (unofficial), https://healthdatauses.uk/agreements/dars-nic-276970-b8y4h/ (accessed [date]).
This address stays the same, but the page is rebuilt with each monthly edition, so the citation names the edition it shows. Every edition's data is kept in the facts store.
Source: datausesregister_september2026.xlsx, September 2026 edition of the NHS England Data Uses Register. Search that workbook for DARS-NIC-276970-B8Y4H to see the original rows.