D5 - Office for National Statistics requirements for NHS-England (formerly NHS Digital) data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
Office for National Statistics (ONS) · Agency/Public Body
In term In term in the September 2026 edition: the latest version runs to 1 May 2027.
- Reference
- DARS-NIC-175120-W5G2X
- Current version
- v17.3
- Term of current version
- 2 May 2026 to 1 May 2027
- Start date
- 8 March 2019
- Data controller
- Sole Data Controller
- Commercial purposes
- No
- Sublicensing
- No
- Files released to date
- 776
Why the data was released
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS England, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://uksa.statisticsauthority.gov.uk/publication/data-access-policy-and-legislation/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this Agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this Data Sharing Agreement. This process involved working closely with NHS England’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS England will also publish the details of this Data Sharing Agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this Agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS England approval. It would also require an appropriate alternative legal gateway because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS England and enter into an amended Data Sharing Agreement before proceeding with that new purpose.
Dataset 1: Birth Notifications data
NHS England has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
There are a wide range of statistical uses to which the Office for National Statistics (ONS) intends to put Birth Notifications data. All use of Birth Notifications data by ONS will be to improve the availability and quality of statistics as part of ONS’s function to produce statistics for the public good.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required.
1.1 Birth and Child Mortality Statistics
The primary statistical purpose for which this information will be used is analysis of births, maternities, infant mortality and child health outcomes. Analyses are made publicly available as aggregate National Statistics.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics. However, there are some limitations with the GRO data, including a time lag, a lack of key information such as length of gestation and ethnicity of the baby, as well as some missing values in the fields that are available. To mitigate these limitations, the NHS England birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. The identifying information required from NHS England will enable and help quality assure this linkage, which in turn will enable ONS to produce more comprehensive and accurate statistics on births and child health outcomes.
As well as linking birth notifications data to birth registrations and deaths data to produce National Statistics these data will also be linked to other sources in order improve and development new statistics. For example, birth notifications data will be linked to:
• birth registration, deaths and census data to identify more detailed characteristics of the household and mother, such as ethnicity, and so better understand inequalities, risk factors and variation in child health outcomes
• deaths, to identify bereaved children, and to other NHS England data to identify subsequent inequalities and outcomes
• other ONS and NHS England data such as Hospital Episode Statistics to better determine underlying cause of death, understand inequalities, risk factors and variation in child outcomes
1.2 Improving data linkage methodology
ONS plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link information relating to siblings born at different times (i.e. not twins) using NHS number of the mother. This produces very accurate linkage of siblings.
ONS can then attempt to link siblings together using only the data available in the registration data – i.e. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the results of the latter linkage method matches those achieved when linking using mother’s NHS number. This will inform the best matching methodology to use when NHS number of the mother is not available (for example in pre-2005 birth registration data).
1.3 Improving population and migration statistics
ONS plans to use births notifications data to support development and improvements of population and migration statistics. This includes a range of work such as quality assurance of Census data, contribution to ONS’s population and migration statistics transformation programme, to put administrative data first and make recommendations on the future of the decennial Census. For example, birth notifications data will be:
• used to validate Census data, with a focus on population sub-groups, such as the under 1s, returned in Census data and subsequently supporting population outputs
• used to contribute to work to estimate or quality assure characteristics of the population, such as ethnicity or age, along with other data sources
• linked to other data sources in order to carry out such improvements to existing or develop new Official Statistics, and to quality assurance other data sources
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – e.g. additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – e.g. where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
• Research and development of methodology – e.g. improving linkage methodology for siblings
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS England data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Based Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Based Census Project (ABC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realised.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
As part of this work ONS will be producing a non-disclosive, de-identified Administrative Based Census (ABC) dataset for research use. This will be a heavily derived data product containing only the age, sex and Lower Layer Super Output Area (LSOA) for records included within the ABC. This ABC output dataset will be produced through amalgamating multiple administrative data sources (including NHS Personal Demographics Service, Hospital Episode Statistics, Emergency Care Dataset plus a multitude of data from other sources) to generate a de-identified record for every usual resident in England and Wales and help estimate the population at a local level. This de-identified, non-disclosive ONS product (the ABC) will be made available for approved / accredited research use within ONS operated Trusted Research Environments (TREs).
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity Data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity, but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data-based ethnicity estimates will be important when deciding whether to move to an admin data-based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS England data experts to understand the limitations of the HES ethnicity data and there are several; for example, coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about when, where, and why people have accessed hospital services, for example diagnosis and procedures codes, for a range of statistical purposes in line with ONS’s function to produce statistics for the public good. All use of the HES data for health analysis will be to improve the availability and quality of health statistics.
The diagnosis and procedures information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, for the first supply of HES data to ONS the volume of this information was minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services was shared with ONS, compared with the information about when and where people have accessed services. ONS has now used and published analysis using these HES data for several purposes described in this Agreement and DARS-NIC-400304-S1P1B (which allows reuse of the HES data ONS hold). Based on learning from this work ONS are now requesting further additional variables and historical times series updates where some variables were only requested for a subset of years to the current HES subset they receive.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
(i) Understanding healthy life expectancy.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
(ii) Understanding health inequalities.
Inclusion is one of the 4 pillars of the ONS strategy ‘Statistics for the Public Good’, as such exploring inequalities across outcomes is a priority for the ONS. Making use of linked morbidity, mortality, census and other data will allow ONS to produce statistics on health inequalities and provide these at a granular level. In particular, linking to these health data will help ONS to better understand if inequalities in outcomes persist when health status or pre-existing conditions are taken into account. For example, ONS have already used HES data to understand comorbidities of the population and to take this into account when modelling the risk of COVID-19 deaths by ethnicity (under DARS-NIC-400304-S1P1B). This allowed ONS to provide evidence that inequalities in outcomes still exist despite controlling for certain, but not all, health conditions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly.
It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible, to develop new measures of avoidable mortality in the elderly that could have been avoided.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality.
The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
d. ONS will use this data in conjunction with other health sources, and non-health sources such as Census, income and benefits data, and survey data, to produce a range of statistics on the interaction between health and the labour market. This is bi-directional, looking both at how health affects economic outcomes and vice versa. Work would include but not be limited to:
• Producing statistics on the prevalence of conditions in people who are inactive in the labour market due to ill health
• Modelling whether a change in the prevalence of certain conditions explain part of the increase in labour market inactivity observed since 2019.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation, and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, new-born and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS England and UK Health Security Agency (UKHSA) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability, and geography. In some cases, NHS England / UKHSA will not hold data that would enable this but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken
Processing activities
Dataset 1: Birth Notifications data
ONS receives the data in real time through its Spine2 connection from NHS England. It arrives as .xml files which are converted on a secure WebLogic server before being transferred to another secure server for processing. Here, it is processed ready for ONS use. This server is separate to those which are used for other datasets from NHS England, due to the long-standing nature of this data share.
The birth notifications data are linked with ONS’s birth registrations data at an individual level. Where possible, NHS number of baby and/or mother are used. In some cases, this will fail, for example when the same NHS number is used twice in the registrations data in error. Therefore, other demographic variables are used for linkage when required. The majority of this is automated matching with no visual inspection of the identifiable data, but in a small number of cases, clerical matching is required. Only a small number of securities cleared, trained, substantive ONS employees are involved with this part of the process.
Once linkage is complete, other variables from the birth notifications data are used to either enhance or validate the birth registrations data. Once the enhancement and validation are complete, all additional birth notification data that are not needed for the production of statistics, notably the identifiers, are removed before any more ONS staff can access the data. As suggested in 5a, the resulting de-identified, linked dataset produced includes additional variables from the birth notifications data that were not on the birth registrations data.
This linked de-identified dataset is transferred to another secure server where health analysts can produce the statistics listed in section 5c. No attempt is made to re-identify individuals; ONS is only interested in producing aggregate statistics for the public good.
ONS employs strict security procedures to protect confidentiality throughout processing. These include:
• Only a small number of substantive ONS employees can access the data and all ONS employees who have access to the data have contractual obligations of confidentiality, enforceable via disciplinary procedures, as set out in the ONS Code of Practice
• Relevant staff are Security Check cleared, and have undergone appropriate training and ongoing supervision to maintain confidentiality and integrity
• Data are held on secure servers with restricted access, the data are only held in an identifiable form for the shortest period necessary to enable the data to be used for the stated purposes
The complete Birth Notification dataset is required, rather than just a sample, because the birth registrations data, which is the primary source for ONS’s birth statistics, is (in theory) a Census of all births. This means the statistics are more accurate than statistics based on surveys that suffer from sampling error.
If the variables that are appended to the registrations data from the birth notifications were only a sample, this would reduce the accuracy of some of the birth statistics, limiting their use and impact. In addition, the difference in accuracy between statistics based on different variables within the same statistical release would be confusing for users.
Some variables that are on the birth registrations have their value overwritten with the equivalent value from the birth notifications data. In this case, only having a sample of birth notifications data, or certain geographic regions, would potentially introduce bias. For example, it would mean ONS’s birth statistics are more accurate for the regions where it has birth notifications data and is therefore able to improve on any implausible values in the birth registrations data, than for those where it would not have been able to do this.
Dataset 1, 2, 3 and 4: Birth Notifications, Hospital Episode Statistics (HES), Improving Access to Psychological Therapies (IAPT) and Emergency Care Dataset data
Data security for storage and linkage of the data will be provided with an assured ONS data analysis environment that includes the following elements of security control:
• Need To Access applied through user account access and management . Access to the data is restricted to individuals granted access on the basis of a justified need to access the data
• Controlled ingest and export of data into/out from the DAP environment
• Controlled account access using unique credentials based on job role
• Logged and monitored access of user activity within the DAP environment
• Secure build configuration for infrastructure
• Vulnerability tested infrastructure with appropriate remediation and patching
• Compliance checks against security enforcing controls
• Architectural review against standards and best practice
• Staff security cleared to the appropriate level based on their supervised and/or unsupervised access to sensitive data in accordance with ONS clearance policies and data access processes
• Education and awareness of environment users covering security policies and secure working practices
• Operational support processes to securely manage the environment
• Risk assessment to identify security risks and mitigation actions to reduce this risk.
Following policy specified by the ONS Chief Security Officer, ONS user access to the data environment is only after approval of an application by the Information Asset Owner including ethical assessment of proposed data use. A list of approved users is available on request.
With reasonable notice, periodic written/verbal checks may be conducted by an authorised employee of NHS England to confirm compliance with this application.
ONS will keep a record of any processing of Personal Data and will provide a copy of such record to NHS England on request. ONS will not transfer or permit the transfer of the Data to any territory outside the UK without the prior written consent of NHS England.
As described in section 5a, the proposed purposes require linkage of records at the individual level. This is why personal identifiers such as date of birth, postcode and NHS number are required. However, ONS is only interested in producing aggregate statistics and using these to uncover trends and other useful insights based on the non-identifiable ‘attribute’ information.
As noted above within the ONS data environment users set up ‘project spaces’ and apply for access to data through the Information Asset Owner, each ‘project space’ includes only the data required to carry out their analysis and only the users who require access to that data. Users will not be permitted to access identifiers for the purposes of analysis. In addition to the system protocols above, ONS will therefore keep the number of staff permitted to process identifiers to an absolute minimum, and these staff will have a higher level of clearance. All other staff will only be permitted to access non-identifying data.
ONS will never seek to intentionally re-identify this data. ONS staff are suitably trained; for example, ONS’s health analysts in particular are experienced working with sensitive data about deaths (such as individual level data about suicides). Further, only statistical disclosure controlled aggregate outputs will be exportable from the secure data analysis environment. In other words, other than the initial transfer of the data from NHS England to ONS, the identifiable data will never be in transit and will always be protected by procedural controls in place now
The reasons complete information on who, when and where people accessed hospital services for 2009/10 onwards is needed varies across the multiple statistical purposes presented in section 5a. The drivers are largely to do with quality and therefore value of the statistics that can be produced using the full dataset compared with less than this, for example a subset or random sample. There is more on statistical quality on the ONS website including the following:
‘The quality of a statistical product can be defined as the “fitness for purpose” of that product. More specifically, it is the fitness for purpose with regards to the European Statistical System dimensions of quality:
• relevance – is the degree to which a statistical product meets user needs in terms of content and coverage
• accuracy and reliability – is how close the estimated value in the output is to the true result
• timeliness and punctuality – describes the time between the date of publication and the date to which the data refers, and the time between the actual publication and the planned publication of a statistic
• accessibility and clarity – is the ease with which users can access data, and the quality and sufficiency of metadata, illustrations and accompanying advice
• coherence and comparability – is the degree to which data derived from different sources or methods, but that refers to the same topic, is similar, and the degree to which data can be compared over time and domain, for example, geographic level
There are additional characteristics that should be considered when thinking about quality. These include output quality trade-offs, user needs and perceptions, performance cost and respondent burden, and confidentiality, transparency, and security.’
The clearest example of the need for the information in this Agreement is using so called activity data to determine where in the country people were/are resident as part of the ONS Administrative Data Census project. This project is developing new population statistics methods and products that cover the whole of England (and beyond), so complete Birth Notifications, HES, ECDS and IAPT coverage is required. In addition, a decision is required post-2021 Census about whether these new methods and statistics can replace the traditional Census. To determine this robustly requires that the new methods and statistics are produced for the whole of the 2011 to 2021 time period. This will allow a robust view to be taken of the level of error and drift of those new statistics during this period, comparing them to the gold standard Census figures available for 2011 and 2021.
For the health analysis purposes presented in section 5a that require why people interacted with hospital services, then similar arguments around quality apply; Health projections that rely on HES diagnosis information will require full coverage for an extended time period. However, this and the other health analysis uses presented are more complex than a lot of the other proposed uses and require more groundwork to determine whether statistics of sufficient quality can be produced. In addition, diagnosis information is clearly more sensitive. As a result, ONS’s initial request for these data determined that it was proportionate and in the public interest that the years’ worth of HES diagnosis information required was minimised. Following analysis using these data ONS are now assured of the utility of these data and are now requiring a backseries of diagnosis codes previously received as well as requiring additional procedure codes.
Analysis using diagnosis information has proved successful in understanding and controlling for hospital-based conditions and comorbidities as part of the ONS’s COVID-19 analysis (see section 5c, 2.6). This analysis provides assurance that these data can also be used successfully for the wider purposes outlined in this Agreement. However, a key limitation of the analysis was the limited number of years of data available and the breadth of variables. For Admitted Patient Care (APC) & Outpatients (OP), ONS has identified further that procedure codes are also required to ensure ONS have a full range of risk predictors and capture important clinical events following discharge from hospital.
In addition, for APC, ONS are also requesting new codes to support new work ONS has been commissioned to do by DHSC on productivity. The work involves taking over analysis previously carried out by University of York and the additional variables requested include only those required to replicate this already established analysis.
Access to data held within the Data Access Platform (DAP), which includes Birth Notifications, HES, ECDS and IAPT data, is granted to users on a need-to-know basis depending on their role, through a request process which provides a business justification. Access is authorised on a case-by-case basis by the ONS Information Asset Owner (IAO) responsible for HES data, with advice from Security and Information Management. Staff requesting access to these data must be cleared to the appropriate National Vetting level, which is higher than the standard basic clearance required for all ONS staff. Only authorised ONS staff with appropriate security clearance will have access to identifiable HES data, with regular audit and monitoring in place to ensure compliance. The Data will be accessed by authorised personnel via remote access.
The Controller(s) must confirm and provide evidence upon audit by NHS England that access via any remote device complies with the data security obligations within this DSA and the Data Sharing Framework Contract.
For remote access:
- Remote access will only be from secure locations situated within the territory of use (as further restricted elsewhere within the DSA if so done) stated within this DSA;
- Access controls granting users the minimum level of access required are in place;
- Remote access is only via secure connections (e.g., VPNs or secure protocols) to protect data;
- Multifactor authentication (MFA) is required for remote access;
- Device security, including up-to-date software and operating systems, antivirus software, and enabled firewalls are utilised for the remote access;
- All remote access is undertaken within the scope of the organisation’s DSPT (or other security arrangements as per this DSA) and complies with the organisation’s remote access policy.
The above applies in addition to any condition set out elsewhere within the DSA (e.g. who may carry out processing, and for what purpose)
This processing activity takes place in a dedicated ONS environment provided by Amazon Web Services, and based in England and Wales only.
The data will reside within Google Cloud Platform (GCP). All cloud services consumed for the storage and use of the data are scoped to securely managed GCP Projects. GCP Projects in scope for this project are not connected to ONS corporate networks. GCP Projects in scope for this project are accessible via the internet for administration/analytical work. Access is securely bound up with Google identity services, internet authentication proxies and multi-factor authentication. All platform infrastructure and storage is deployed into the Europe-west2 region (London) and in any of the 3 available zones for redundancy and high availability (where applicable). Processing of data can only be carried out on GCP infrastructure within the deployed region. Access to GCP platform is region locked to UK IP addresses only. Access to IDS and any data it holds is not permitted from outside the UK. Overseas connections are monitored, and connection attempts will lead to account suspension
The Secure Research Service (SRS) is hosted at Ark Data Centres, and is managed in-house at ONS.
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is usually released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released over the year in a series of themed packages. Child and infant mortality statistics and unexplained infant deaths are published annually. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
ONS are looking to improve and develop new statistics using newly linked data to explore inequalities, risk factors and variation in child outcomes. Outputs in the form of presentations, analytical articles and methodology reports will be created alongside data tables as appropriate. ONS publishes all its official statistics on its website.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Improving population and migration statistics: This will result in internal, and potentially external, ONS reports and presentations on how births notification data could be used to improve and develop official statistics, and potentially used directly in the development of new official statistics. ONS publishes all its official statistics on its website.
Dataset 2, 3 and 4: Hospital Episode Statistics, Improving Access to Psychological Therapies and Emergency Care Dataset data
The initial uses to which ONS will put HES, IAPT and ECDS data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Initial work has been carried out and new statistics published using HES data as part of the response to the coronavirus pandemic which has assured ONS of the quality and validity of using these data as initially intended such that additional data is being requested as part of this Agreement to address limitations in the initial supply of HES data. Research outputs have been published on the ONS website, for example: https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/updatingethniccontrastsindeathsinvolvingthecoronaviruscovid19englandandwales/deathsoccurring2marchto28july2020
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES, IAPT or ECDS data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users and will seek to provide frequent updates on these projects during that first stage.
As part of ONS' work on producing more accurate statistics on the population at a local level through administrative data, a non-disclosive, de-identified Administrative Based Census (ABC) dataset will be created for research use. This will be a heavily derived data product containing only the age, sex and Lower Layer Super Output Area (LSOA) for records included within the ABC. This ABC output dataset will be produced through amalgamating multiple administrative data sources (including NHS Personal Demographics Service, Hospital Episode Statistics, Emergency Care Dataset plus a multitude of data from other sources) to generate a de-identified record for every usual resident in England and Wales and help estimate the population at a local level. This de-identified, non-disclosive ONS product (the ABC) will be made available for approved / accredited research use within ONS operated Trusted Research Environments (TREs).
Expected measurable benefits
As per section 5a, the legal gateway under which data will flow from NHS England to ONS will be Section 45c of the SRSA 2007 (as amended by the Digital Economy Act 2017). This means ONS can require that data are shared as long as the data are required for its functions, and the share is in line with the statistical statement of principles that underpins these powers.
These considerations include that the purposes to which ONS puts the data must be in the public interest and serve the public good. However, for this legal gateway, the benefits do not need to be to health and social care specifically. This is unlike some other legal gateways under which NHS England data can be disseminated, for example section 251 of the NHS Act 2006, when research outcomes must benefit health and social care.
In the above context, the following will briefly cover all the potential benefits by dataset.
Dataset 1: Benefits of the ONS births statistics which depend on the Birth Notifications data
Local authorities and other government departments are important users of birth statistics and use the data for planning and resource allocation. For example, local authorities use birth statistics to decide how many school places will be needed in a given area. The Department for Work and Pensions uses detailed birth statistics to feed into statistical models they use for pensions and benefits. The Department of Health uses the data to plan maternity services and inform policy decisions.
Other users of births, child and infant mortality and child outcome statistics include academics, demographers, and health researchers, who conduct research into trends and characteristics. Lobby groups use the statistics for their cause, for example, campaigns against school closures or midwife shortages. Special interest groups, such as Birth Choice UK, make the data available to enable comparisons between maternity units to help women choose where they might like to give birth, and work closely with health professionals. Charities, such as the Twins and Multiple Births Association provide advice and support to multiple birth parents and use the data to monitor trends. Organisations such as Eurostat and the UN use ONS birth and child and infant mortality statistics for international comparison purposes. The media also report on trends and statistics.
In addition, ONS’ births data is used as a component of its population statistics. Population estimates and projections are also used extensively throughout government and specifically by the Department of Health and their agencies for the planning and provision of health and social care services, and the distribution of funds. Throughout government, decisions on the distribution of billions of pounds of funds are made based on population estimates and projections.
In addition, they are used as the denominator in any statistics that are published on a per capita basis. For example, any health data published per capita for a particular level of geography (national, regional, local authority, clinical commissioning group, parliamentary constituency etc) is almost certain to use ONS estimated or projected population as the denominator. Population estimates and projections are published by age and sex. This means that they can also be used to better target age and sex specific health and care services (e.g., maternity, aging populations etc)
Benefits of Data Linkage Methodology Research that will use the birth notifications data: Any improvements in Data linkage expertise and methodology would be an enabler to other projects and therefore their benefits. This is because the more accurately data can be linked, the more accurate any statistics derived from the linked dataset will be. The benefits of these projects may or may not be relevant to health and social care – for example, many of the projects involving HES data will depend on accurate data linkage.
Dataset 2: Predicted Benefits of the uses for Hospital Episode Statistics data
2.1. Benefits of the Admin Based Census Project and Improved Migration Statistics
Population estimates and information on population characteristics are used by a wide range of national and local organisations for numerous purposes including resource and funding allocation for both local and central Government, service planning and delivery, policy development, monitoring and evaluation, and providing an accurate denominator for other statistics.
The Department of Health and their agencies use ONS’ population statistics for the planning and provision of health and social care services and the distribution of funds. Throughout government, decisions on the distribution of billions of pounds of funds are made based on population estimates and projections.
Respondents to the Census Topic Consultation conducted in June 2015 gave strong evidence for high-quality and more timely population estimates. If it proves feasible, an Admin Based Census approach will deliver more timely statistics. It will potentially also deliver more accurate and timely population statistics, at least in inter-censal periods, if not traditional census year itself. An Admin Based Census approach will also reduce cost and respondent burden.
New and more accurate information on international and internal migration is needed to better inform migration system policy making in a post-Brexit era. Evidence of this includes the 2017 Migration Advisory Committee call for evidence on aspects of migration, in response to a Government commission to guide decisions on post-Brexit migration policy and the cross-Government Statistical Service (GSS) migration transformation programme
The availability of a non-disclosive, de-identified Admin Based Census (ABC) dataset for approved / accredited use through ONS operated Trusted Research Environments (TREs) will enable much richer insights to be gained when used alongside other research datasets. For example it will allow for more detailed analysis at a local level to be undertaken by researchers, to help policy makers and the public better understand what is happening in towns and cities across England and Wales and any disparities that may exist between areas.
2.2. Benefits of the Health Analyses
Successful production of robust health projections would support better decision making around where to set the state pension age, and planning of health and social care services:
Evidence of this includes the Cridland report, 2017 which was commissioned by government to independently review the state pension age, and made the following statement:
(https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/611460/independent-review-of-the-state-pension-age-smoothing-the-transition.pdf)
“We believe more work is needed to understand healthy life expectancy, as it affects a range of policy areas. Projecting healthy life expectancy into the future is not currently possible, but would be valuable for future Reviews, as well as in work around health and caring.”
The report also notes:
• Developments in Healthy Life Expectancy and Health State Transitions will have a notable impact on the demand for social care and different types of medical care, for instance the number of trained dementia nurses required in 40 years’ time
• In order to manage budgets and allocate funding effectively, there is a need to understand what the main patterns of key diseases will be, and what the distribution of these illnesses across the population will look like
• It is likely that the prevalence of diseases which affect the oldest old such as cancer and dementia will increase
• If social care and health care provision needs to be increased, the national budget will need to be changed to reflect this which may result in other services seeing cuts.
Current healthy life expectancy estimates rely on ONS surveys, where despite the large sample size, the number of possible breakdowns geographically and by characteristic is limited by this sample size. Current estimates also rely on aggregate figures – ie the prevalence of poor health / limiting long term conditions, and also mortality rates by age are calculated independently and then fed into the model. These factors limit the accuracy of the model.
Linking health states and mortality at the individual level over time, and for a greater proportion of the population (which may be possible using HES data) will allow more granular analysis. Linking to Census and other sources to add in other characteristics, could inform interventions to support tackling inequalities at the local level.
Improving understanding of causes of death in vulnerable population groups such as the elderly and infants, by using HES diagnostic data to supplement the registered causes of death, will improve mortality statistics which are currently relied on by government for a wide range of policy and resource allocation purposes and as indicators in the NHS outcomes frameworks.
Developing a better understanding of complex causes of death in the elderly will help to address an internationally acknowledged issue which is of growing importance as the average age of the population, and the proportion of deaths which are among elderly people, increases globally. There is international interest in developing new measures of avoidable death in the elderly, and the potential of studies on this to help identify those who are most at risk and target preventive interventions.
2.3. Benefits of Improving the ONS Address Register
This research will enhance the Address Register including the information held on communal establishments (CEs), for which there is currently a recognized data gap. A better Address Register will in turn benefit ONS’ other statistics, such as the population statistics described earlier. For example, it will allow ONS to quality assure its local level population statistics (whether from a traditional Census or other method) as local areas with CEs can have unusual demographic profiles, which can cause concern over the accuracy of the statistics unless the location and nature of the CE is known. It will also help with better planning of survey operations and sample design.
2.4. Benefits of Improving UK household Expenditure
Household Final Consumption Expenditure is a component of National Accounts; improvements to its accuracy therefore improve estimates of Gross Domestic Product (GDP). GDP is a key national economic indicator that drives national economic policy making, in turn potentially affecting the wellbeing (financial or otherwise) of everyone in the country.
2.5. Benefits of Improving ONS Sustainable Development Indicators
The UK was at the forefront of developing the United Nations recognized Sustainable Development Goals (SDGs). ONS aims to fully report UK progress against these goals (i.e., have data available for the SDG indicators that have been proposed), given the UK was heavily involved in SDG development, and wants to continue to show leadership in this space.
A key theme of the SDGs is to leave no one behind and ONS needs to be able to disaggregate the headline indicators so that it can be sure progress occurs across all groups, regardless of ethnicity, age, sex, disability, geography. Subject feasibility research, linking HES data to ONS held data such as from Census 2011 at an individual level, may help to achieve this goal.
In some cases, reporting against the SDG indicators will not always enable better decision making on UK government policy, but it will encourage other nations to fully report against the indicators, and by extension enable better decision making in those nations.
2.6 Benefits of supporting Covid-19 analysis
Analysis of the impact of having had COVID-19 and the impact of the pandemic on society, the economy and the environment will enable the government to better respond to the ongoing public health crisis, for example through tailored public health interventions.
This analysis is of national public health importance and has been requested by central government leaders and advisors such as SAGE and the government, via the National Statistician. The results of the analysis will be used to inform members of SAGE, Members of Parliament (MPs) and other government officials of the differing COVID-19 risk profiles experienced by UK citizens. These statistics will enable the government to refine its policy response to the pandemic using the best evidence available.
The analysis may also improve the public’s understanding of the risk faced by certain population groups, leading to more informed decision making, and add to the growing body of literature being produced and evaluated by the global academic community. Ultimately this analysis has the potential to deliver public health benefit by reducing COVID-19 related mortality and morbidity in the UK, and potentially saving lives.
Dataset 3: Benefits of the uses for IAPT data
3.1. Benefits of the Admin Data Census project and improved migration statistics
This is essentially the same as described for the uses of HES data within ONS’ Admin Data Census Project. See section 2.1 above (within the HES section) for benefits of these uses.
3.2. Benefits of Statistical Research and Health Analyses using IAPT data
Mental health is a high priority in government policy. Co-morbidities between mental and physical health, as well as inequalities in mental health, are of increasing interest within health policy.
In their response to the Five Year Forward View (FYFV), NHS England set an objective for the majority of new common mental health disorder (CMD) services to be integrated with physical healthcare by 2020/21. This is in line with a King’s Fund report which provided evidence for the strong links between mental and physical health.
This project will add to the evidence base by:
• providing information on many physical conditions (rather than a focus on only a few key health problems, as in the Adult Psychiatric Morbidity Survey)
• providing a detailed demographic context, including information such as ethnicity, sexual orientation, occupation, marital status
• Investigating inequalities
Investigating the links between mental health, mortality, and co-morbidity has clear benefits for the public. By determining physical and mental health conditions that commonly co-occur, the government can target its health services to better meet the needs of patients resulting in a better patient experience, and ultimately could saves lives. For example, it may be that a particular cause of death has an increased prevalence in patients with CMD compared to the general population; by ensuring policy makers and clinical staff are aware of this, prevention and intervention could be more targeted.
The second benefit of the project is analysis of inequalities in mental health, in line with the FYFV “focus on tackling inequalities. Mental health problems disproportionately affect people living in poverty, those who are unemployed and who already face discrimination”. The King’s Fund found that people with long term physical health problems and co-morbid mental illness disproportionately live in deprived areas. This analysis would allow detailed geographical mapping of those with a CMD who died from particular causes, and analysis by deprivation deciles.
Other demographic variables could also be used for inequalities analysis to investigate any difference in premature mortality in certain demographic groups of IAPT users (age, sex, or occupation) versus the general population. Obtaining this information will benefit the public by allowing healthcare providers to target groups who may be disproportionately affected by physical and mental health problems, and subsequently reduce premature mortality due to co-morbidities.
The benefits of the other health statistics mentioned in section 5a (3.2) to which IAPT data will contribute are already described under the benefits gained from ONS acquiring HES data.
Dataset 4: Predicted Benefits of the uses for ECDS data
Again, as ECDS is replacing the HES A&E data, the benefits described for HES data in section 2 will also apply to ECDS data.
In addition to the those described in section 2, ECDS data would also have an additional benefits as follows:
4.1. Benefits of using ECDS data for Crime Statistics (including knife and drug related crime)
There has been recognition, both nationally and internationally, of the benefit of the use of data collected by emergency departments for informing violence and injury prevention. The ONS Centre for Crime and Justice are carrying out exploratory analysis to improve the statistical evidence base on violent crime.
The ECDS data are used to address two key aims:
1. To explore the usefulness and feasibility of using urgent and emergency care attendance data to further understand the impact of violent crime on services (crime harm) within crime statistics
2. To explore the usefulness and feasibility of using urgent and emergency care attendance to further understand the specific impact of domestic violence on services
Both strands of the project are with public benefit in mind.
The Crime Harm strand is aimed at exploring and proposing a new, improved way of measuring crime harm. The new tool has a potential to be a more innovative, reliable, and inclusive measure of crime harm. An improved, more nuanced tool could have a range of positive impacts including better, more targeted allocation of police resources, more cost-effective public services expenditure, further research contributing to the current evidence base related to crime harm.
The domestic violence strand work can potentially help inform interventions and crime prevention work. Analysing data from the ECDS could help inform local and government policy, which in turn could reduce the numbers of assault victims. This would be of benefit for emergency departments and the NHS, in terms of reducing burden and would have cost savings. The ECDS data as a supplement to the CSEW domestic violence data can also help to give a more comprehensive and accurate picture of domestic violence in the UK and contribute to better monitoring of domestic violence rates and the progress towards the Sustainable Development Goals.
4.2 Waiting time on Mortality
This research aims to investigate the effect of hospital waiting time in Emergency Departments (EDs) on mortality. Whilst ONS conducted initial analyses using aggregated data at the Integrated Care Board (ICB) level, data aggregation prevents ONS from investigating finer trends unique to individual patients and their care journeys through EDs.
Previous studies explore patient outcomes following ED attendance controlling for individual level characteristics, including age, sex, comorbidities, deprivation and history of ED attendance / emergency admission.
Therefore essential aspects of understanding patient level outcome must include:
• Comorbidities: comorbidities are a measure of patient’s disease complexity. A patient’s comorbidity is an important confounder to control for, to exclude possibilities of selection bias in ED (ie, sicker patients waiting longer because they take more time to treat). Sicker patients may also be more likely to die, irrespective of waiting time.
• Acuity & diagnosis code: a patient’s acuity is another essential confounder to control for which is not captured by comorbidity. It enables to adjust for non-linear relationships between waiting time and mortality: ie, whilst a patient with an acute condition has higher chances of death, acute conditions are likely to be picked up faster in ED due to triage. It is essential to understand triage effects to understand in which case increased waiting time may impact mortality. Acuity has not been included in previous study designs and would represent an important improvement.
To provide continuity of information, replicate and improve on previous studies, it is essential that our research include these variables in the statistical modelling. The quality of ONS's findings would be jeopardized without these metric, as it is critical to disentangle what effect hospital waiting time is having on patient outcomes without over-simplifying trends. The highest risk ONS could incur in this scenario is to make policy recommendations which would have no impact on patient’s outcomes.
Benefits reported so far
Dataset 1: Benefits of the ONS births statistics which depend on the Birth Notifications data.
ONS has released research and statistics regarding Life expectancy, healthy life expectancy, disability-free life expectancy, slope index of inequality and range at birth and age 65 by national deprivation deciles across England from 2011 to 2019. Alongside our National Statistics 'Births' releases these have been used by various users across central government (Department of Health & Social Care, UK Health Security Agency, Department for Work & Pensions) local authorities, charities and international bodies (Eurostat and the UN).
Dataset 2: Predicted Benefits of the uses for Hospital Episode Statistics data
2.1. Benefits of the Admin Based Census Project and Improved Migration Statistics
ONS has used both HES and ECDS within construction of the Statistical Population Dataset (SPD), specifically they're used as a 'sign of life' or activity indicator to identify whether someone should be included in the usually resident population. This is a new methodology and still under development, most recently ONS published an update on this work in February 2023.
2.2. Benefits of the Health Analyses
ONS has used HES extensively for key health analysis:
Published April 2022, Suicides among people diagnosed with severe health conditions, England. This was based on mortality records linked to the 2011 Census and Hospital Episode Statistics.
Published September 2023, Climate-related mortality and hospital admissions, England. Counts and rates of deaths and hospital admissions associated with temperature for England from 2001 to 2020.
Published November 2023, Quality of ethnicity data in Hospital Episode Statistics, England, including APC, OP and A&E. Including ECDS.
Published April 2024, Health Outcomes of unpaid carers using, Hospital Episode Statistics, England.
2.3. Benefits of Improving the ONS Address Register
This work is still under development, however progress here has also helped in the construction of the Admin Based Census. Data on communal establishments in particular has been vital for improving ONS' Address Index.
2.4. Benefits of Improving UK household Expenditure
This work is still ongoing, ONS will provide an update on this in due course.
2.5. Benefits of Improving ONS Sustainable Development Indicators
ONS most recently published an article in April 2023 providing an update on our research to improve reporting of sex and gender within the context of the UN's Sustainable Development Goals, mentioning the use of NHS data to form part of the published indicators.
2.6 Benefits of supporting Covid-19 analysis
During the pandemic the ONS published extensive COVID-19 statistics, many of which used NHS data (provisioned under DARS-NIC-400304). Most recently ONS has published the following articles:
Published July 2022, COVID-19 hospital admissions by vaccination and pregnancy status, England.
Published March 2023, Risk of death following COVID-19 vaccination or positive SARS-CoV-2 test in young people, England.
More detailed benefits are set out within DARS-NIC-400304
Dataset 3: Benefits of the uses for IAPT data
3.1. Benefits of the Admin Data Census project and improved migration statistics
This data has been used under the same population statistics purposes as HES and ECDS, see 2.1 above.
3.2. Benefits of Statistical Research and Health Analyses using IAPT data
Most recently, ONS has published the following article:
Published June 2022, Socio-demographic differences in use of the Improving Access to Psychological Therapies services. IAPT services treatment rates, Common mental disorder rates and proportion of people with probable CMD who received treatment through IAPT services, for England, 1 April 2017 to 31 March 2018.
Dataset 4: Benefits of the uses for ECDS data
As ECDS is replacing the HES A&E data, the benefits described for HES data in section 2 will also apply to ECDS data.
In addition to the those described in section 2, ECDS data would also have an additional benefits as follows:
4.1. Benefits of using ECDS data for Crime Statistics (including knife and drug related crime)
Most recently, ONS has published the following article:
Published 16 November 2023, Offences involving the use of weapons, data relating to offences involving weapons as recorded by police within the ECDS dataset.
4.2 Waiting time on Mortality
This work is still ongoing, ONS will provide an update on this in due course.
Datasets on the current version
Legal basis for provision: Other-Data dissemination is mandated under section 45c of the Statistics and Registration Service Act (2007) as amended by the Digital Economy Act 2017; Other-(Data dissemination is mandated under section 45c of the Statistics and Registration Service Act (2007) as amended by the Digital Economy Act 2017); Other-Data dissemination is mandated under section 45c of the Statistics and Registration Service Act (2007) as amended by the Digital Economy Act 2017)
| Dataset | Type of data | Sensitivity | Frequency | Confidential data |
|---|---|---|---|---|
| Birth Notification Data | Identifiable | Non-Sensitive | One-Off | Statutory exemption to flow confidential data without consent |
| Emergency Care Data Set (ECDS) | Identifiable | Sensitive | Ongoing | Statutory exemption to flow confidential data without consent |
| HES-ID to MPS-ID HES Accident and Emergency | Anonymised - ICO Code Compliant | Non-Sensitive | One-Off | Statutory exemption to flow confidential data without consent |
| HES-ID to MPS-ID HES Admitted Patient Care | Anonymised - ICO Code Compliant | Non-Sensitive | One-Off | Statutory exemption to flow confidential data without consent |
| HES-ID to MPS-ID HES Outpatients | Anonymised - ICO Code Compliant | Non-Sensitive | One-Off | Statutory exemption to flow confidential data without consent |
| Hospital Episode Statistics Accident and Emergency (HES A and E) | Identifiable | Sensitive | One-Off | Statutory exemption to flow confidential data without consent |
| Hospital Episode Statistics Admitted Patient Care (HES APC) | Identifiable | Sensitive | Ongoing | Statutory exemption to flow confidential data without consent |
| Hospital Episode Statistics Critical Care (HES Critical Care) | Identifiable | Non-Sensitive | Ongoing | Statutory exemption to flow confidential data without consent |
| Hospital Episode Statistics Outpatients (HES OP) | Identifiable | Sensitive | Ongoing | Statutory exemption to flow confidential data without consent |
| Improving Access to Psychological Therapies (IAPT) v1.5 | Identifiable | Sensitive | Ongoing | Statutory exemption to flow confidential data without consent |
| Improving Access to Psychological Therapies (IAPT) v2 | Identifiable | Sensitive | Ongoing | Statutory exemption to flow confidential data without consent |
Files released
Files released counts only files released externally by DARS. Access granted in NHS England's own systems, such as its Secure Data Environment, is not included.
Patient opt-outs were not applied to any of the 776 files released under this agreement, across every version. About opt-outs
Files released against version 17.3 of this agreement, summarised by dataset.
| Dataset | Files | First released | Last released | Opt-outs applied |
|---|---|---|---|---|
| Improving Access to Psychological Therapies (IAPT) v2 | 45 | May 2026 | July 2026 | No |
| Hospital Episode Statistics Admitted Patient Care (HES APC) | 4 | May 2026 | August 2026 | No |
| Hospital Episode Statistics Outpatients (HES OP) | 4 | May 2026 | August 2026 | No |
| Emergency Care Data Set (ECDS) | 3 | May 2026 | August 2026 | No |
| Hospital Episode Statistics Critical Care (HES Critical Care) | 2 | July 2026 | August 2026 | No |
Version history
The register lists each renewal of this agreement as a separate row. This site has 18 versions.
DARS-NIC-175120-W5G2X-v17.3 2 May 2026 to 1 May 2027
- Title
- D5 - Office for National Statistics requirements for NHS-England (formerly NHS Digital) data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 11
- Files released
- 58
Datasets: Birth Notification Data; Emergency Care Data Set (ECDS); HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES-ID to MPS-ID HES Outpatients; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Critical Care (HES Critical Care); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5; Improving Access to Psychological Therapies (IAPT) v2
What changed from DARS-NIC-175120-W5G2X-v16.2
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2026-05-02 | |
| End date | 2027-05-01 |
Datasets: + Hospital Episode Statistics Critical Care (HES Critical Care)
Processing activities
[56 paragraphs unchanged]
The SRS is hosted on the iTS computing Ltd Cloud platform. The servers used to store data and to host the analysis environment are located within a Pan-Government and National Cyber Security Centre (NCSC) Accredited (PGA) data centre, provided by iTS computing Ltd Data Centres and based in England and Wales only.
The Secure Research Service (SRS) is hosted at Ark Data Centres, and is managed in-house at ONS.
Unchanged: Objective for processing, Expected output, Expected measurable benefits, Benefits reported.
DARS-NIC-175120-W5G2X-v16.2 2 May 2025 to 1 May 2026
- Title
- D5 - Office for National Statistics requirements for NHS-England (formerly NHS Digital) data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 10
- Files released
- 138
Datasets: Birth Notification Data; Emergency Care Data Set (ECDS); HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES-ID to MPS-ID HES Outpatients; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5; Improving Access to Psychological Therapies (IAPT) v2
What changed from DARS-NIC-175120-W5G2X-v15.4
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2025-05-02 | |
| End date | 2026-05-01 |
Unchanged: Objective for processing, Processing activities, Expected output, Expected measurable benefits, Benefits reported.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS England, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://uksa.statisticsauthority.gov.uk/publication/data-access-policy-and-legislation/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this Agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this Data Sharing Agreement. This process involved working closely with NHS England’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS England will also publish the details of this Data Sharing Agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this Agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS England approval. It would also require an appropriate alternative legal gateway because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS England and enter into an amended Data Sharing Agreement before proceeding with that new purpose.
Dataset 1: Birth Notifications data
NHS England has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
There are a wide range of statistical uses to which the Office for National Statistics (ONS) intends to put Birth Notifications data. All use of Birth Notifications data by ONS will be to improve the availability and quality of statistics as part of ONS’s function to produce statistics for the public good.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required.
1.1 Birth and Child Mortality Statistics
The primary statistical purpose for which this information will be used is analysis of births, maternities, infant mortality and child health outcomes. Analyses are made publicly available as aggregate National Statistics.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics. However, there are some limitations with the GRO data, including a time lag, a lack of key information such as length of gestation and ethnicity of the baby, as well as some missing values in the fields that are available. To mitigate these limitations, the NHS England birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. The identifying information required from NHS England will enable and help quality assure this linkage, which in turn will enable ONS to produce more comprehensive and accurate statistics on births and child health outcomes.
As well as linking birth notifications data to birth registrations and deaths data to produce National Statistics these data will also be linked to other sources in order improve and development new statistics. For example, birth notifications data will be linked to:
• birth registration, deaths and census data to identify more detailed characteristics of the household and mother, such as ethnicity, and so better understand inequalities, risk factors and variation in child health outcomes
• deaths, to identify bereaved children, and to other NHS England data to identify subsequent inequalities and outcomes
• other ONS and NHS England data such as Hospital Episode Statistics to better determine underlying cause of death, understand inequalities, risk factors and variation in child outcomes
1.2 Improving data linkage methodology
ONS plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link information relating to siblings born at different times (i.e. not twins) using NHS number of the mother. This produces very accurate linkage of siblings.
ONS can then attempt to link siblings together using only the data available in the registration data – i.e. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the results of the latter linkage method matches those achieved when linking using mother’s NHS number. This will inform the best matching methodology to use when NHS number of the mother is not available (for example in pre-2005 birth registration data).
1.3 Improving population and migration statistics
ONS plans to use births notifications data to support development and improvements of population and migration statistics. This includes a range of work such as quality assurance of Census data, contribution to ONS’s population and migration statistics transformation programme, to put administrative data first and make recommendations on the future of the decennial Census. For example, birth notifications data will be:
• used to validate Census data, with a focus on population sub-groups, such as the under 1s, returned in Census data and subsequently supporting population outputs
• used to contribute to work to estimate or quality assure characteristics of the population, such as ethnicity or age, along with other data sources
• linked to other data sources in order to carry out such improvements to existing or develop new Official Statistics, and to quality assurance other data sources
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – e.g. additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – e.g. where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
• Research and development of methodology – e.g. improving linkage methodology for siblings
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS England data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Based Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Based Census Project (ABC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realised.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
As part of this work ONS will be producing a non-disclosive, de-identified Administrative Based Census (ABC) dataset for research use. This will be a heavily derived data product containing only the age, sex and Lower Layer Super Output Area (LSOA) for records included within the ABC. This ABC output dataset will be produced through amalgamating multiple administrative data sources (including NHS Personal Demographics Service, Hospital Episode Statistics, Emergency Care Dataset plus a multitude of data from other sources) to generate a de-identified record for every usual resident in England and Wales and help estimate the population at a local level. This de-identified, non-disclosive ONS product (the ABC) will be made available for approved / accredited research use within ONS operated Trusted Research Environments (TREs).
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity Data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity, but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data-based ethnicity estimates will be important when deciding whether to move to an admin data-based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS England data experts to understand the limitations of the HES ethnicity data and there are several; for example, coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about when, where, and why people have accessed hospital services, for example diagnosis and procedures codes, for a range of statistical purposes in line with ONS’s function to produce statistics for the public good. All use of the HES data for health analysis will be to improve the availability and quality of health statistics.
The diagnosis and procedures information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, for the first supply of HES data to ONS the volume of this information was minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services was shared with ONS, compared with the information about when and where people have accessed services. ONS has now used and published analysis using these HES data for several purposes described in this Agreement and DARS-NIC-400304-S1P1B (which allows reuse of the HES data ONS hold). Based on learning from this work ONS are now requesting further additional variables and historical times series updates where some variables were only requested for a subset of years to the current HES subset they receive.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
(i) Understanding healthy life expectancy.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
(ii) Understanding health inequalities.
Inclusion is one of the 4 pillars of the ONS strategy ‘Statistics for the Public Good’, as such exploring inequalities across outcomes is a priority for the ONS. Making use of linked morbidity, mortality, census and other data will allow ONS to produce statistics on health inequalities and provide these at a granular level. In particular, linking to these health data will help ONS to better understand if inequalities in outcomes persist when health status or pre-existing conditions are taken into account. For example, ONS have already used HES data to understand comorbidities of the population and to take this into account when modelling the risk of COVID-19 deaths by ethnicity (under DARS-NIC-400304-S1P1B). This allowed ONS to provide evidence that inequalities in outcomes still exist despite controlling for certain, but not all, health conditions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly.
It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible, to develop new measures of avoidable mortality in the elderly that could have been avoided.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality.
The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
d. ONS will use this data in conjunction with other health sources, and non-health sources such as Census, income and benefits data, and survey data, to produce a range of statistics on the interaction between health and the labour market. This is bi-directional, looking both at how health affects economic outcomes and vice versa. Work would include but not be limited to:
• Producing statistics on the prevalence of conditions in people who are inactive in the labour market due to ill health
• Modelling whether a change in the prevalence of certain conditions explain part of the increase in labour market inactivity observed since 2019.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation, and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, new-born and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS England and UK Health Security Agency (UKHSA) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability, and geography. In some cases, NHS England / UKHSA will not hold data that would enable this but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is usually released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released over the year in a series of themed packages. Child and infant mortality statistics and unexplained infant deaths are published annually. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
ONS are looking to improve and develop new statistics using newly linked data to explore inequalities, risk factors and variation in child outcomes. Outputs in the form of presentations, analytical articles and methodology reports will be created alongside data tables as appropriate. ONS publishes all its official statistics on its website.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Improving population and migration statistics: This will result in internal, and potentially external, ONS reports and presentations on how births notification data could be used to improve and develop official statistics, and potentially used directly in the development of new official statistics. ONS publishes all its official statistics on its website.
Dataset 2, 3 and 4: Hospital Episode Statistics, Improving Access to Psychological Therapies and Emergency Care Dataset data
The initial uses to which ONS will put HES, IAPT and ECDS data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Initial work has been carried out and new statistics published using HES data as part of the response to the coronavirus pandemic which has assured ONS of the quality and validity of using these data as initially intended such that additional data is being requested as part of this Agreement to address limitations in the initial supply of HES data. Research outputs have been published on the ONS website, for example: https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/updatingethniccontrastsindeathsinvolvingthecoronaviruscovid19englandandwales/deathsoccurring2marchto28july2020
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES, IAPT or ECDS data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users and will seek to provide frequent updates on these projects during that first stage.
As part of ONS' work on producing more accurate statistics on the population at a local level through administrative data, a non-disclosive, de-identified Administrative Based Census (ABC) dataset will be created for research use. This will be a heavily derived data product containing only the age, sex and Lower Layer Super Output Area (LSOA) for records included within the ABC. This ABC output dataset will be produced through amalgamating multiple administrative data sources (including NHS Personal Demographics Service, Hospital Episode Statistics, Emergency Care Dataset plus a multitude of data from other sources) to generate a de-identified record for every usual resident in England and Wales and help estimate the population at a local level. This de-identified, non-disclosive ONS product (the ABC) will be made available for approved / accredited research use within ONS operated Trusted Research Environments (TREs).
Benefits reported
Dataset 1: Benefits of the ONS births statistics which depend on the Birth Notifications data.
ONS has released research and statistics regarding Life expectancy, healthy life expectancy, disability-free life expectancy, slope index of inequality and range at birth and age 65 by national deprivation deciles across England from 2011 to 2019. Alongside our National Statistics 'Births' releases these have been used by various users across central government (Department of Health & Social Care, UK Health Security Agency, Department for Work & Pensions) local authorities, charities and international bodies (Eurostat and the UN).
Dataset 2: Predicted Benefits of the uses for Hospital Episode Statistics data
2.1. Benefits of the Admin Based Census Project and Improved Migration Statistics
ONS has used both HES and ECDS within construction of the Statistical Population Dataset (SPD), specifically they're used as a 'sign of life' or activity indicator to identify whether someone should be included in the usually resident population. This is a new methodology and still under development, most recently ONS published an update on this work in February 2023.
2.2. Benefits of the Health Analyses
ONS has used HES extensively for key health analysis:
Published April 2022, Suicides among people diagnosed with severe health conditions, England. This was based on mortality records linked to the 2011 Census and Hospital Episode Statistics.
Published September 2023, Climate-related mortality and hospital admissions, England. Counts and rates of deaths and hospital admissions associated with temperature for England from 2001 to 2020.
Published November 2023, Quality of ethnicity data in Hospital Episode Statistics, England, including APC, OP and A&E. Including ECDS.
Published April 2024, Health Outcomes of unpaid carers using, Hospital Episode Statistics, England.
2.3. Benefits of Improving the ONS Address Register
This work is still under development, however progress here has also helped in the construction of the Admin Based Census. Data on communal establishments in particular has been vital for improving ONS' Address Index.
2.4. Benefits of Improving UK household Expenditure
This work is still ongoing, ONS will provide an update on this in due course.
2.5. Benefits of Improving ONS Sustainable Development Indicators
ONS most recently published an article in April 2023 providing an update on our research to improve reporting of sex and gender within the context of the UN's Sustainable Development Goals, mentioning the use of NHS data to form part of the published indicators.
2.6 Benefits of supporting Covid-19 analysis
During the pandemic the ONS published extensive COVID-19 statistics, many of which used NHS data (provisioned under DARS-NIC-400304). Most recently ONS has published the following articles:
Published July 2022, COVID-19 hospital admissions by vaccination and pregnancy status, England.
Published March 2023, Risk of death following COVID-19 vaccination or positive SARS-CoV-2 test in young people, England.
More detailed benefits are set out within DARS-NIC-400304
Dataset 3: Benefits of the uses for IAPT data
3.1. Benefits of the Admin Data Census project and improved migration statistics
This data has been used under the same population statistics purposes as HES and ECDS, see 2.1 above.
3.2. Benefits of Statistical Research and Health Analyses using IAPT data
Most recently, ONS has published the following article:
Published June 2022, Socio-demographic differences in use of the Improving Access to Psychological Therapies services. IAPT services treatment rates, Common mental disorder rates and proportion of people with probable CMD who received treatment through IAPT services, for England, 1 April 2017 to 31 March 2018.
Dataset 4: Benefits of the uses for ECDS data
As ECDS is replacing the HES A&E data, the benefits described for HES data in section 2 will also apply to ECDS data.
In addition to the those described in section 2, ECDS data would also have an additional benefits as follows:
4.1. Benefits of using ECDS data for Crime Statistics (including knife and drug related crime)
Most recently, ONS has published the following article:
Published 16 November 2023, Offences involving the use of weapons, data relating to offences involving weapons as recorded by police within the ECDS dataset.
4.2 Waiting time on Mortality
This work is still ongoing, ONS will provide an update on this in due course.
DARS-NIC-175120-W5G2X-v15.4 17 January 2025 to 29 August 2027
- Title
- D5 - Office for National Statistics requirements for NHS-England (formerly NHS Digital) data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 10
- Files released
- 36
Datasets: Birth Notification Data; Emergency Care Data Set (ECDS); HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES-ID to MPS-ID HES Outpatients; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5; Improving Access to Psychological Therapies (IAPT) v2
What changed from DARS-NIC-175120-W5G2X-v14.6
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2025-01-17 | |
| End date | 2027-08-29 |
Objective for processing
[59 paragraphs unchanged]
2.1. To enable ONS’s Administrative
Data
Based
Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative
Data
Based
Census Project
(ADC)
(ABC)
is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realised.
[1 paragraph unchanged]
As part of this work ONS will be producing a non-disclosive, de-identified Administrative Based Census (ABC) dataset for research use. This will be a heavily derived data product containing only the age, sex and Lower Layer Super Output Area (LSOA) for records included within the ABC. This ABC output dataset will be produced through amalgamating multiple administrative data sources (including NHS Personal Demographics Service, Hospital Episode Statistics, Emergency Care Dataset plus a multitude of data from other sources) to generate a de-identified record for every usual resident in England and Wales and help estimate the population at a local level. This de-identified, non-disclosive ONS product (the ABC) will be made available for approved / accredited research use within ONS operated Trusted Research Environments (TREs).
[64 paragraphs unchanged]
This is of critical priority across government as part of the UK’s
[12 words unchanged]
of the virus, helping to inform a range of policy decisions taken
by central government, health services and others.
ONS previously held HES data covering up until March 2019 and was to receive annual updates. This is not timely enough to enable all of the aims of the project. The gap in HES data between April 2019 to February 2020 (from before the UK epidemic) means ONS did not have an up-to-date picture of underlying health conditions. Getting retrospective monthly HES data for this period will fill this gap sooner than waiting for the final annual 2019/20 extract which will be supplied by NHSD in October 2020.
ONS also needs hospital data from during the UK epidemic to have visibility of those who are hospitalised from COVID-19 but then recover. An ongoing monthly supply of HES data will provide ONS with this information much sooner than an annual supply would provide.
A separate Agr
Processing activities
[54 paragraphs unchanged] This processing activity takes place in a dedicated ONS environment provided by Amazon Web Services, and based in England and Wales only. The data will reside within Google Cloud Platform (GCP). All cloud services consumed for the storage and use of the data are scoped to securely managed GCP Projects. GCP Projects in scope for this project are not connected to ONS corporate networks. GCP Projects in scope for this project are accessible via the internet for administration/analytical work. Access is securely bound up with Google identity services, internet authentication proxies and multi-factor authentication. All platform infrastructure and storage is deployed into the Europe-west2 region (London) and in any of the 3 available zones for redundancy and high availability (where applicable). Processing of data can only be carried out on GCP infrastructure within the deployed region. Access to GCP platform is region locked to UK IP addresses only. Access to IDS and any data it holds is not permitted from outside the UK. Overseas connections are monitored, and connection attempts will lead to account suspension The SRS is hosted on the iTS computing Ltd Cloud platform. The servers used to store data and to host the analysis environment are located within a Pan-Government and National Cyber Security Centre (NCSC) Accredited (PGA) data centre, provided by iTS computing Ltd Data Centres and based in England and Wales only.
Expected output
[16 paragraphs unchanged] As part of ONS' work on producing more accurate statistics on the population at a local level through administrative data, a non-disclosive, de-identified Administrative Based Census (ABC) dataset will be created for research use. This will be a heavily derived data product containing only the age, sex and Lower Layer Super Output Area (LSOA) for records included within the ABC. This ABC output dataset will be produced through amalgamating multiple administrative data sources (including NHS Personal Demographics Service, Hospital Episode Statistics, Emergency Care Dataset plus a multitude of data from other sources) to generate a de-identified record for every usual resident in England and Wales and help estimate the population at a local level. This de-identified, non-disclosive ONS product (the ABC) will be made available for approved / accredited research use within ONS operated Trusted Research Environments (TREs).
Expected measurable benefits
[10 paragraphs unchanged]
2.1. Benefits of the Admin
Data
Based
Census Project and Improved Migration Statistics
[2 paragraphs unchanged]
Respondents to the Census Topic Consultation conducted in June 2015 gave strong evidence for high-quality and more timely population estimates. If it proves feasible, an Admin
Data
Based
Census approach will deliver more timely statistics. It will potentially also deliver
[7 words unchanged]
least in inter-censal periods, if not traditional census year itself. An Admin
Data
Based
Census approach will also reduce cost and respondent burden.
[1 paragraph unchanged]
The availability of a non-disclosive, de-identified Admin Based Census (ABC) dataset for approved / accredited use through ONS operated Trusted Research Environments (TREs) will enable much richer insights to be gained when used alongside other research datasets. For example it will allow for more detailed analysis at a local level to be undertaken by researchers, to help policy makers and the public better understand what is happening in towns and cities across England and Wales and any disparities that may exist between areas.
[58 paragraphs unchanged]
Benefits reported
Not stated in the previous version; added here.
Dataset 1: Benefits of the ONS births statistics which depend on the Birth Notifications data.
ONS has released research and statistics regarding Life expectancy, healthy life expectancy, disability-free life expectancy, slope index of inequality and range at birth and age 65 by national deprivation deciles across England from 2011 to 2019. Alongside our National Statistics 'Births' releases these have been used by various users across central government (Department of Health & Social Care, UK Health Security Agency, Department for Work & Pensions) local authorities, charities and international bodies (Eurostat and the UN).
Dataset 2: Predicted Benefits of the uses for Hospital Episode Statistics data
2.1. Benefits of the Admin Based Census Project and Improved Migration Statistics
ONS has used both HES and ECDS within construction of the Statistical Population Dataset (SPD), specifically they're used as a 'sign of life' or activity indicator to identify whether someone should be included in the usually resident population. This is a new methodology and still under development, most recently ONS published an update on this work in February 2023.
2.2. Benefits of the Health Analyses
ONS has used HES extensively for key health analysis:
Published April 2022, Suicides among people diagnosed with severe health conditions, England. This was based on mortality records linked to the 2011 Census and Hospital Episode Statistics.
Published September 2023, Climate-related mortality and hospital admissions, England. Counts and rates of deaths and hospital admissions associated with temperature for England from 2001 to 2020.
Published November 2023, Quality of ethnicity data in Hospital Episode Statistics, England, including APC, OP and A&E. Including ECDS.
Published April 2024, Health Outcomes of unpaid carers using, Hospital Episode Statistics, England.
2.3. Benefits of Improving the ONS Address Register
This work is still under development, however progress here has also helped in the construction of the Admin Based Census. Data on communal establishments in particular has been vital for improving ONS' Address Index.
2.4. Benefits of Improving UK household Expenditure
This work is still ongoing, ONS will provide an update on this in due course.
2.5. Benefits of Improving ONS Sustainable Development Indicators
ONS most recently published an article in April 2023 providing an update on our research to improve reporting of sex and gender within the context of the UN's Sustainable Development Goals, mentioning the use of NHS data to form part of the published indicators.
2.6 Benefits of supporting Covid-19 analysis
During the pandemic the ONS published extensive COVID-19 statistics, many of which used NHS data (provisioned under DARS-NIC-400304). Most recently ONS has published the following articles:
Published July 2022, COVID-19 hospital admissions by vaccination and pregnancy status, England.
Published March 2023, Risk of death following COVID-19 vaccination or positive SARS-CoV-2 test in young people, England.
More detailed benefits are set out within DARS-NIC-400304
Dataset 3: Benefits of the uses for IAPT data
3.1. Benefits of the Admin Data Census project and improved migration statistics
This data has been used under the same population statistics purposes as HES and ECDS, see 2.1 above.
3.2. Benefits of Statistical Research and Health Analyses using IAPT data
Most recently, ONS has published the following article:
Published June 2022, Socio-demographic differences in use of the Improving Access to Psychological Therapies services. IAPT services treatment rates, Common mental disorder rates and proportion of people with probable CMD who received treatment through IAPT services, for England, 1 April 2017 to 31 March 2018.
Dataset 4: Benefits of the uses for ECDS data
As ECDS is replacing the HES A&E data, the benefits described for HES data in section 2 will also apply to ECDS data.
In addition to the those described in section 2, ECDS data would also have an additional benefits as follows:
4.1. Benefits of using ECDS data for Crime Statistics (including knife and drug related crime)
Most recently, ONS has published the following article:
Published 16 November 2023, Offences involving the use of weapons, data relating to offences involving weapons as recorded by police within the ECDS dataset.
4.2 Waiting time on Mortality
This work is still ongoing, ONS will provide an update on this in due course.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS England, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://uksa.statisticsauthority.gov.uk/publication/data-access-policy-and-legislation/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this Agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this Data Sharing Agreement. This process involved working closely with NHS England’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS England will also publish the details of this Data Sharing Agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this Agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS England approval. It would also require an appropriate alternative legal gateway because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS England and enter into an amended Data Sharing Agreement before proceeding with that new purpose.
Dataset 1: Birth Notifications data
NHS England has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
There are a wide range of statistical uses to which the Office for National Statistics (ONS) intends to put Birth Notifications data. All use of Birth Notifications data by ONS will be to improve the availability and quality of statistics as part of ONS’s function to produce statistics for the public good.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required.
1.1 Birth and Child Mortality Statistics
The primary statistical purpose for which this information will be used is analysis of births, maternities, infant mortality and child health outcomes. Analyses are made publicly available as aggregate National Statistics.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics. However, there are some limitations with the GRO data, including a time lag, a lack of key information such as length of gestation and ethnicity of the baby, as well as some missing values in the fields that are available. To mitigate these limitations, the NHS England birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. The identifying information required from NHS England will enable and help quality assure this linkage, which in turn will enable ONS to produce more comprehensive and accurate statistics on births and child health outcomes.
As well as linking birth notifications data to birth registrations and deaths data to produce National Statistics these data will also be linked to other sources in order improve and development new statistics. For example, birth notifications data will be linked to:
• birth registration, deaths and census data to identify more detailed characteristics of the household and mother, such as ethnicity, and so better understand inequalities, risk factors and variation in child health outcomes
• deaths, to identify bereaved children, and to other NHS England data to identify subsequent inequalities and outcomes
• other ONS and NHS England data such as Hospital Episode Statistics to better determine underlying cause of death, understand inequalities, risk factors and variation in child outcomes
1.2 Improving data linkage methodology
ONS plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link information relating to siblings born at different times (i.e. not twins) using NHS number of the mother. This produces very accurate linkage of siblings.
ONS can then attempt to link siblings together using only the data available in the registration data – i.e. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the results of the latter linkage method matches those achieved when linking using mother’s NHS number. This will inform the best matching methodology to use when NHS number of the mother is not available (for example in pre-2005 birth registration data).
1.3 Improving population and migration statistics
ONS plans to use births notifications data to support development and improvements of population and migration statistics. This includes a range of work such as quality assurance of Census data, contribution to ONS’s population and migration statistics transformation programme, to put administrative data first and make recommendations on the future of the decennial Census. For example, birth notifications data will be:
• used to validate Census data, with a focus on population sub-groups, such as the under 1s, returned in Census data and subsequently supporting population outputs
• used to contribute to work to estimate or quality assure characteristics of the population, such as ethnicity or age, along with other data sources
• linked to other data sources in order to carry out such improvements to existing or develop new Official Statistics, and to quality assurance other data sources
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – e.g. additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – e.g. where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
• Research and development of methodology – e.g. improving linkage methodology for siblings
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS England data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Based Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Based Census Project (ABC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realised.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
As part of this work ONS will be producing a non-disclosive, de-identified Administrative Based Census (ABC) dataset for research use. This will be a heavily derived data product containing only the age, sex and Lower Layer Super Output Area (LSOA) for records included within the ABC. This ABC output dataset will be produced through amalgamating multiple administrative data sources (including NHS Personal Demographics Service, Hospital Episode Statistics, Emergency Care Dataset plus a multitude of data from other sources) to generate a de-identified record for every usual resident in England and Wales and help estimate the population at a local level. This de-identified, non-disclosive ONS product (the ABC) will be made available for approved / accredited research use within ONS operated Trusted Research Environments (TREs).
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity Data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity, but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data-based ethnicity estimates will be important when deciding whether to move to an admin data-based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS England data experts to understand the limitations of the HES ethnicity data and there are several; for example, coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about when, where, and why people have accessed hospital services, for example diagnosis and procedures codes, for a range of statistical purposes in line with ONS’s function to produce statistics for the public good. All use of the HES data for health analysis will be to improve the availability and quality of health statistics.
The diagnosis and procedures information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, for the first supply of HES data to ONS the volume of this information was minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services was shared with ONS, compared with the information about when and where people have accessed services. ONS has now used and published analysis using these HES data for several purposes described in this Agreement and DARS-NIC-400304-S1P1B (which allows reuse of the HES data ONS hold). Based on learning from this work ONS are now requesting further additional variables and historical times series updates where some variables were only requested for a subset of years to the current HES subset they receive.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
(i) Understanding healthy life expectancy.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
(ii) Understanding health inequalities.
Inclusion is one of the 4 pillars of the ONS strategy ‘Statistics for the Public Good’, as such exploring inequalities across outcomes is a priority for the ONS. Making use of linked morbidity, mortality, census and other data will allow ONS to produce statistics on health inequalities and provide these at a granular level. In particular, linking to these health data will help ONS to better understand if inequalities in outcomes persist when health status or pre-existing conditions are taken into account. For example, ONS have already used HES data to understand comorbidities of the population and to take this into account when modelling the risk of COVID-19 deaths by ethnicity (under DARS-NIC-400304-S1P1B). This allowed ONS to provide evidence that inequalities in outcomes still exist despite controlling for certain, but not all, health conditions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly.
It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible, to develop new measures of avoidable mortality in the elderly that could have been avoided.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality.
The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
d. ONS will use this data in conjunction with other health sources, and non-health sources such as Census, income and benefits data, and survey data, to produce a range of statistics on the interaction between health and the labour market. This is bi-directional, looking both at how health affects economic outcomes and vice versa. Work would include but not be limited to:
• Producing statistics on the prevalence of conditions in people who are inactive in the labour market due to ill health
• Modelling whether a change in the prevalence of certain conditions explain part of the increase in labour market inactivity observed since 2019.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation, and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, new-born and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS England and UK Health Security Agency (UKHSA) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability, and geography. In some cases, NHS England / UKHSA will not hold data that would enable this but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is usually released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released over the year in a series of themed packages. Child and infant mortality statistics and unexplained infant deaths are published annually. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
ONS are looking to improve and develop new statistics using newly linked data to explore inequalities, risk factors and variation in child outcomes. Outputs in the form of presentations, analytical articles and methodology reports will be created alongside data tables as appropriate. ONS publishes all its official statistics on its website.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Improving population and migration statistics: This will result in internal, and potentially external, ONS reports and presentations on how births notification data could be used to improve and develop official statistics, and potentially used directly in the development of new official statistics. ONS publishes all its official statistics on its website.
Dataset 2, 3 and 4: Hospital Episode Statistics, Improving Access to Psychological Therapies and Emergency Care Dataset data
The initial uses to which ONS will put HES, IAPT and ECDS data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Initial work has been carried out and new statistics published using HES data as part of the response to the coronavirus pandemic which has assured ONS of the quality and validity of using these data as initially intended such that additional data is being requested as part of this Agreement to address limitations in the initial supply of HES data. Research outputs have been published on the ONS website, for example: https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/updatingethniccontrastsindeathsinvolvingthecoronaviruscovid19englandandwales/deathsoccurring2marchto28july2020
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES, IAPT or ECDS data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users and will seek to provide frequent updates on these projects during that first stage.
As part of ONS' work on producing more accurate statistics on the population at a local level through administrative data, a non-disclosive, de-identified Administrative Based Census (ABC) dataset will be created for research use. This will be a heavily derived data product containing only the age, sex and Lower Layer Super Output Area (LSOA) for records included within the ABC. This ABC output dataset will be produced through amalgamating multiple administrative data sources (including NHS Personal Demographics Service, Hospital Episode Statistics, Emergency Care Dataset plus a multitude of data from other sources) to generate a de-identified record for every usual resident in England and Wales and help estimate the population at a local level. This de-identified, non-disclosive ONS product (the ABC) will be made available for approved / accredited research use within ONS operated Trusted Research Environments (TREs).
Benefits reported
Dataset 1: Benefits of the ONS births statistics which depend on the Birth Notifications data.
ONS has released research and statistics regarding Life expectancy, healthy life expectancy, disability-free life expectancy, slope index of inequality and range at birth and age 65 by national deprivation deciles across England from 2011 to 2019. Alongside our National Statistics 'Births' releases these have been used by various users across central government (Department of Health & Social Care, UK Health Security Agency, Department for Work & Pensions) local authorities, charities and international bodies (Eurostat and the UN).
Dataset 2: Predicted Benefits of the uses for Hospital Episode Statistics data
2.1. Benefits of the Admin Based Census Project and Improved Migration Statistics
ONS has used both HES and ECDS within construction of the Statistical Population Dataset (SPD), specifically they're used as a 'sign of life' or activity indicator to identify whether someone should be included in the usually resident population. This is a new methodology and still under development, most recently ONS published an update on this work in February 2023.
2.2. Benefits of the Health Analyses
ONS has used HES extensively for key health analysis:
Published April 2022, Suicides among people diagnosed with severe health conditions, England. This was based on mortality records linked to the 2011 Census and Hospital Episode Statistics.
Published September 2023, Climate-related mortality and hospital admissions, England. Counts and rates of deaths and hospital admissions associated with temperature for England from 2001 to 2020.
Published November 2023, Quality of ethnicity data in Hospital Episode Statistics, England, including APC, OP and A&E. Including ECDS.
Published April 2024, Health Outcomes of unpaid carers using, Hospital Episode Statistics, England.
2.3. Benefits of Improving the ONS Address Register
This work is still under development, however progress here has also helped in the construction of the Admin Based Census. Data on communal establishments in particular has been vital for improving ONS' Address Index.
2.4. Benefits of Improving UK household Expenditure
This work is still ongoing, ONS will provide an update on this in due course.
2.5. Benefits of Improving ONS Sustainable Development Indicators
ONS most recently published an article in April 2023 providing an update on our research to improve reporting of sex and gender within the context of the UN's Sustainable Development Goals, mentioning the use of NHS data to form part of the published indicators.
2.6 Benefits of supporting Covid-19 analysis
During the pandemic the ONS published extensive COVID-19 statistics, many of which used NHS data (provisioned under DARS-NIC-400304). Most recently ONS has published the following articles:
Published July 2022, COVID-19 hospital admissions by vaccination and pregnancy status, England.
Published March 2023, Risk of death following COVID-19 vaccination or positive SARS-CoV-2 test in young people, England.
More detailed benefits are set out within DARS-NIC-400304
Dataset 3: Benefits of the uses for IAPT data
3.1. Benefits of the Admin Data Census project and improved migration statistics
This data has been used under the same population statistics purposes as HES and ECDS, see 2.1 above.
3.2. Benefits of Statistical Research and Health Analyses using IAPT data
Most recently, ONS has published the following article:
Published June 2022, Socio-demographic differences in use of the Improving Access to Psychological Therapies services. IAPT services treatment rates, Common mental disorder rates and proportion of people with probable CMD who received treatment through IAPT services, for England, 1 April 2017 to 31 March 2018.
Dataset 4: Benefits of the uses for ECDS data
As ECDS is replacing the HES A&E data, the benefits described for HES data in section 2 will also apply to ECDS data.
In addition to the those described in section 2, ECDS data would also have an additional benefits as follows:
4.1. Benefits of using ECDS data for Crime Statistics (including knife and drug related crime)
Most recently, ONS has published the following article:
Published 16 November 2023, Offences involving the use of weapons, data relating to offences involving weapons as recorded by police within the ECDS dataset.
4.2 Waiting time on Mortality
This work is still ongoing, ONS will provide an update on this in due course.
DARS-NIC-175120-W5G2X-v14.6 9 February 2024 to 31 October 2026
- Title
- D5 - Office for National Statistics requirements for NHS-England (formerly NHS Digital) data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 10
- Files released
- 144
Datasets: Birth Notification Data; Emergency Care Data Set (ECDS); HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES-ID to MPS-ID HES Outpatients; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5; Improving Access to Psychological Therapies (IAPT) v2
What changed from DARS-NIC-175120-W5G2X-v13.2
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2024-02-09 | |
| Improving Access to Psychological Therapies (IAPT) v2: legal basis | Other-Data dissemination is mandated under section 45c of the Statistics and Registration Service Act (2007) as amended by the Digital Economy Act 2017 |
Unchanged: Objective for processing, Processing activities, Expected output, Expected measurable benefits.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS England, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://uksa.statisticsauthority.gov.uk/publication/data-access-policy-and-legislation/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this Agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this Data Sharing Agreement. This process involved working closely with NHS England’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS England will also publish the details of this Data Sharing Agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this Agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS England approval. It would also require an appropriate alternative legal gateway because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS England and enter into an amended Data Sharing Agreement before proceeding with that new purpose.
Dataset 1: Birth Notifications data
NHS England has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
There are a wide range of statistical uses to which the Office for National Statistics (ONS) intends to put Birth Notifications data. All use of Birth Notifications data by ONS will be to improve the availability and quality of statistics as part of ONS’s function to produce statistics for the public good.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required.
1.1 Birth and Child Mortality Statistics
The primary statistical purpose for which this information will be used is analysis of births, maternities, infant mortality and child health outcomes. Analyses are made publicly available as aggregate National Statistics.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics. However, there are some limitations with the GRO data, including a time lag, a lack of key information such as length of gestation and ethnicity of the baby, as well as some missing values in the fields that are available. To mitigate these limitations, the NHS England birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. The identifying information required from NHS England will enable and help quality assure this linkage, which in turn will enable ONS to produce more comprehensive and accurate statistics on births and child health outcomes.
As well as linking birth notifications data to birth registrations and deaths data to produce National Statistics these data will also be linked to other sources in order improve and development new statistics. For example, birth notifications data will be linked to:
• birth registration, deaths and census data to identify more detailed characteristics of the household and mother, such as ethnicity, and so better understand inequalities, risk factors and variation in child health outcomes
• deaths, to identify bereaved children, and to other NHS England data to identify subsequent inequalities and outcomes
• other ONS and NHS England data such as Hospital Episode Statistics to better determine underlying cause of death, understand inequalities, risk factors and variation in child outcomes
1.2 Improving data linkage methodology
ONS plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link information relating to siblings born at different times (i.e. not twins) using NHS number of the mother. This produces very accurate linkage of siblings.
ONS can then attempt to link siblings together using only the data available in the registration data – i.e. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the results of the latter linkage method matches those achieved when linking using mother’s NHS number. This will inform the best matching methodology to use when NHS number of the mother is not available (for example in pre-2005 birth registration data).
1.3 Improving population and migration statistics
ONS plans to use births notifications data to support development and improvements of population and migration statistics. This includes a range of work such as quality assurance of Census data, contribution to ONS’s population and migration statistics transformation programme, to put administrative data first and make recommendations on the future of the decennial Census. For example, birth notifications data will be:
• used to validate Census data, with a focus on population sub-groups, such as the under 1s, returned in Census data and subsequently supporting population outputs
• used to contribute to work to estimate or quality assure characteristics of the population, such as ethnicity or age, along with other data sources
• linked to other data sources in order to carry out such improvements to existing or develop new Official Statistics, and to quality assurance other data sources
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – e.g. additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – e.g. where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
• Research and development of methodology – e.g. improving linkage methodology for siblings
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS England data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realised.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity Data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity, but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data-based ethnicity estimates will be important when deciding whether to move to an admin data-based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS England data experts to understand the limitations of the HES ethnicity data and there are several; for example, coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about when, where, and why people have accessed hospital services, for example diagnosis and procedures codes, for a range of statistical purposes in line with ONS’s function to produce statistics for the public good. All use of the HES data for health analysis will be to improve the availability and quality of health statistics.
The diagnosis and procedures information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, for the first supply of HES data to ONS the volume of this information was minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services was shared with ONS, compared with the information about when and where people have accessed services. ONS has now used and published analysis using these HES data for several purposes described in this Agreement and DARS-NIC-400304-S1P1B (which allows reuse of the HES data ONS hold). Based on learning from this work ONS are now requesting further additional variables and historical times series updates where some variables were only requested for a subset of years to the current HES subset they receive.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
(i) Understanding healthy life expectancy.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
(ii) Understanding health inequalities.
Inclusion is one of the 4 pillars of the ONS strategy ‘Statistics for the Public Good’, as such exploring inequalities across outcomes is a priority for the ONS. Making use of linked morbidity, mortality, census and other data will allow ONS to produce statistics on health inequalities and provide these at a granular level. In particular, linking to these health data will help ONS to better understand if inequalities in outcomes persist when health status or pre-existing conditions are taken into account. For example, ONS have already used HES data to understand comorbidities of the population and to take this into account when modelling the risk of COVID-19 deaths by ethnicity (under DARS-NIC-400304-S1P1B). This allowed ONS to provide evidence that inequalities in outcomes still exist despite controlling for certain, but not all, health conditions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly.
It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible, to develop new measures of avoidable mortality in the elderly that could have been avoided.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality.
The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
d. ONS will use this data in conjunction with other health sources, and non-health sources such as Census, income and benefits data, and survey data, to produce a range of statistics on the interaction between health and the labour market. This is bi-directional, looking both at how health affects economic outcomes and vice versa. Work would include but not be limited to:
• Producing statistics on the prevalence of conditions in people who are inactive in the labour market due to ill health
• Modelling whether a change in the prevalence of certain conditions explain part of the increase in labour market inactivity observed since 2019.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation, and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, new-born and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS England and UK Health Security Agency (UKHSA) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability, and geography. In some cases, NHS England / UKHSA will not hold data that would enable this but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken by central government, health services and others.
ONS previously held HES data covering up until March 2019 and was to receive annual updates. This is not timely enough to enable all of the aims of the project. The gap in HES data between April 2019 to February 2020 (from before the UK epidemic) means ONS did not have an up-to-date picture of underlying health conditions. Getting retrospective monthly HES data for this period will fill this gap sooner than waiting for the final annual 2019/20 extract which will be supplied by NHSD in October 2020.
ONS also needs hospital data from during the UK epidemic to have visibility of those who are hospitalised from COVID-19 but then recover. An ongoing monthly supply of HES data will provide ONS with this information much sooner than an annual supply would provide.
A separate Agr
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is usually released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released over the year in a series of themed packages. Child and infant mortality statistics and unexplained infant deaths are published annually. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
ONS are looking to improve and develop new statistics using newly linked data to explore inequalities, risk factors and variation in child outcomes. Outputs in the form of presentations, analytical articles and methodology reports will be created alongside data tables as appropriate. ONS publishes all its official statistics on its website.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Improving population and migration statistics: This will result in internal, and potentially external, ONS reports and presentations on how births notification data could be used to improve and develop official statistics, and potentially used directly in the development of new official statistics. ONS publishes all its official statistics on its website.
Dataset 2, 3 and 4: Hospital Episode Statistics, Improving Access to Psychological Therapies and Emergency Care Dataset data
The initial uses to which ONS will put HES, IAPT and ECDS data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Initial work has been carried out and new statistics published using HES data as part of the response to the coronavirus pandemic which has assured ONS of the quality and validity of using these data as initially intended such that additional data is being requested as part of this Agreement to address limitations in the initial supply of HES data. Research outputs have been published on the ONS website, for example: https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/updatingethniccontrastsindeathsinvolvingthecoronaviruscovid19englandandwales/deathsoccurring2marchto28july2020
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES, IAPT or ECDS data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users and will seek to provide frequent updates on these projects during that first stage.
DARS-NIC-175120-W5G2X-v13.2 30 November 2023 to 31 October 2026
- Title
- D5 - Office for National Statistics requirements for NHS-England (formerly NHS Digital) data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 10
- Files released
- 44
Datasets: Birth Notification Data; Emergency Care Data Set (ECDS); HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES-ID to MPS-ID HES Outpatients; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5; Improving Access to Psychological Therapies (IAPT) v2
What changed from DARS-NIC-175120-W5G2X-v12.2
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Title | D5 - Office for National Statistics requirements for NHS-England (formerly NHS Digital) data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017 | |
| Start date | 2023-11-30 | |
| End date | 2026-10-31 |
Datasets: + Improving Access to Psychological Therapies (IAPT) v2
Objective for processing
[2 paragraphs unchanged]
https://www.statisticsauthority.gov.uk/publication/delivering-better-statistics-for-better-decisions-data-access-legislation-march-2016/
https://uksa.statisticsauthority.gov.uk/publication/data-access-policy-and-legislation/
[125 paragraphs unchanged]
ONS also needs hospital data from during the UK epidemic to have
[15 words unchanged]
of HES data will provide ONS with this information much sooner than
an annual supply would provide.
A separate Agr
Processing activities
[44 paragraphs unchanged] Access to data held within the Data Access Platform (DAP), which includes [94 words unchanged] HES data, with regular audit and monitoring in place to ensure compliance. The Data will be accessed by authorised personnel via remote access. The Controller(s) must confirm and provide evidence upon audit by NHS England that access via any remote device complies with the data security obligations within this DSA and the Data Sharing Framework Contract. For remote access: - Remote access will only be from secure locations situated within the territory of use (as further restricted elsewhere within the DSA if so done) stated within this DSA; - Access controls granting users the minimum level of access required are in place; - Remote access is only via secure connections (e.g., VPNs or secure protocols) to protect data; - Multifactor authentication (MFA) is required for remote access; - Device security, including up-to-date software and operating systems, antivirus software, and enabled firewalls are utilised for the remote access; - All remote access is undertaken within the scope of the organisation’s DSPT (or other security arrangements as per this DSA) and complies with the organisation’s remote access policy. The above applies in addition to any condition set out elsewhere within the DSA (e.g. who may carry out processing, and for what purpose)
Unchanged: Expected output, Expected measurable benefits.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS England, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://uksa.statisticsauthority.gov.uk/publication/data-access-policy-and-legislation/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this Agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this Data Sharing Agreement. This process involved working closely with NHS England’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS England will also publish the details of this Data Sharing Agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this Agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS England approval. It would also require an appropriate alternative legal gateway because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS England and enter into an amended Data Sharing Agreement before proceeding with that new purpose.
Dataset 1: Birth Notifications data
NHS England has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
There are a wide range of statistical uses to which the Office for National Statistics (ONS) intends to put Birth Notifications data. All use of Birth Notifications data by ONS will be to improve the availability and quality of statistics as part of ONS’s function to produce statistics for the public good.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required.
1.1 Birth and Child Mortality Statistics
The primary statistical purpose for which this information will be used is analysis of births, maternities, infant mortality and child health outcomes. Analyses are made publicly available as aggregate National Statistics.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics. However, there are some limitations with the GRO data, including a time lag, a lack of key information such as length of gestation and ethnicity of the baby, as well as some missing values in the fields that are available. To mitigate these limitations, the NHS England birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. The identifying information required from NHS England will enable and help quality assure this linkage, which in turn will enable ONS to produce more comprehensive and accurate statistics on births and child health outcomes.
As well as linking birth notifications data to birth registrations and deaths data to produce National Statistics these data will also be linked to other sources in order improve and development new statistics. For example, birth notifications data will be linked to:
• birth registration, deaths and census data to identify more detailed characteristics of the household and mother, such as ethnicity, and so better understand inequalities, risk factors and variation in child health outcomes
• deaths, to identify bereaved children, and to other NHS England data to identify subsequent inequalities and outcomes
• other ONS and NHS England data such as Hospital Episode Statistics to better determine underlying cause of death, understand inequalities, risk factors and variation in child outcomes
1.2 Improving data linkage methodology
ONS plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link information relating to siblings born at different times (i.e. not twins) using NHS number of the mother. This produces very accurate linkage of siblings.
ONS can then attempt to link siblings together using only the data available in the registration data – i.e. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the results of the latter linkage method matches those achieved when linking using mother’s NHS number. This will inform the best matching methodology to use when NHS number of the mother is not available (for example in pre-2005 birth registration data).
1.3 Improving population and migration statistics
ONS plans to use births notifications data to support development and improvements of population and migration statistics. This includes a range of work such as quality assurance of Census data, contribution to ONS’s population and migration statistics transformation programme, to put administrative data first and make recommendations on the future of the decennial Census. For example, birth notifications data will be:
• used to validate Census data, with a focus on population sub-groups, such as the under 1s, returned in Census data and subsequently supporting population outputs
• used to contribute to work to estimate or quality assure characteristics of the population, such as ethnicity or age, along with other data sources
• linked to other data sources in order to carry out such improvements to existing or develop new Official Statistics, and to quality assurance other data sources
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – e.g. additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – e.g. where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
• Research and development of methodology – e.g. improving linkage methodology for siblings
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS England data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realised.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity Data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity, but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data-based ethnicity estimates will be important when deciding whether to move to an admin data-based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS England data experts to understand the limitations of the HES ethnicity data and there are several; for example, coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about when, where, and why people have accessed hospital services, for example diagnosis and procedures codes, for a range of statistical purposes in line with ONS’s function to produce statistics for the public good. All use of the HES data for health analysis will be to improve the availability and quality of health statistics.
The diagnosis and procedures information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, for the first supply of HES data to ONS the volume of this information was minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services was shared with ONS, compared with the information about when and where people have accessed services. ONS has now used and published analysis using these HES data for several purposes described in this Agreement and DARS-NIC-400304-S1P1B (which allows reuse of the HES data ONS hold). Based on learning from this work ONS are now requesting further additional variables and historical times series updates where some variables were only requested for a subset of years to the current HES subset they receive.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
(i) Understanding healthy life expectancy.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
(ii) Understanding health inequalities.
Inclusion is one of the 4 pillars of the ONS strategy ‘Statistics for the Public Good’, as such exploring inequalities across outcomes is a priority for the ONS. Making use of linked morbidity, mortality, census and other data will allow ONS to produce statistics on health inequalities and provide these at a granular level. In particular, linking to these health data will help ONS to better understand if inequalities in outcomes persist when health status or pre-existing conditions are taken into account. For example, ONS have already used HES data to understand comorbidities of the population and to take this into account when modelling the risk of COVID-19 deaths by ethnicity (under DARS-NIC-400304-S1P1B). This allowed ONS to provide evidence that inequalities in outcomes still exist despite controlling for certain, but not all, health conditions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly.
It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible, to develop new measures of avoidable mortality in the elderly that could have been avoided.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality.
The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
d. ONS will use this data in conjunction with other health sources, and non-health sources such as Census, income and benefits data, and survey data, to produce a range of statistics on the interaction between health and the labour market. This is bi-directional, looking both at how health affects economic outcomes and vice versa. Work would include but not be limited to:
• Producing statistics on the prevalence of conditions in people who are inactive in the labour market due to ill health
• Modelling whether a change in the prevalence of certain conditions explain part of the increase in labour market inactivity observed since 2019.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation, and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, new-born and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS England and UK Health Security Agency (UKHSA) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability, and geography. In some cases, NHS England / UKHSA will not hold data that would enable this but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken by central government, health services and others.
ONS previously held HES data covering up until March 2019 and was to receive annual updates. This is not timely enough to enable all of the aims of the project. The gap in HES data between April 2019 to February 2020 (from before the UK epidemic) means ONS did not have an up-to-date picture of underlying health conditions. Getting retrospective monthly HES data for this period will fill this gap sooner than waiting for the final annual 2019/20 extract which will be supplied by NHSD in October 2020.
ONS also needs hospital data from during the UK epidemic to have visibility of those who are hospitalised from COVID-19 but then recover. An ongoing monthly supply of HES data will provide ONS with this information much sooner than an annual supply would provide.
A separate Agr
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is usually released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released over the year in a series of themed packages. Child and infant mortality statistics and unexplained infant deaths are published annually. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
ONS are looking to improve and develop new statistics using newly linked data to explore inequalities, risk factors and variation in child outcomes. Outputs in the form of presentations, analytical articles and methodology reports will be created alongside data tables as appropriate. ONS publishes all its official statistics on its website.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Improving population and migration statistics: This will result in internal, and potentially external, ONS reports and presentations on how births notification data could be used to improve and develop official statistics, and potentially used directly in the development of new official statistics. ONS publishes all its official statistics on its website.
Dataset 2, 3 and 4: Hospital Episode Statistics, Improving Access to Psychological Therapies and Emergency Care Dataset data
The initial uses to which ONS will put HES, IAPT and ECDS data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Initial work has been carried out and new statistics published using HES data as part of the response to the coronavirus pandemic which has assured ONS of the quality and validity of using these data as initially intended such that additional data is being requested as part of this Agreement to address limitations in the initial supply of HES data. Research outputs have been published on the ONS website, for example: https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/updatingethniccontrastsindeathsinvolvingthecoronaviruscovid19englandandwales/deathsoccurring2marchto28july2020
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES, IAPT or ECDS data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users and will seek to provide frequent updates on these projects during that first stage.
DARS-NIC-175120-W5G2X-v12.2 18 October 2023 to 31 March 2025
- Title
- D5 - Office for National Statistics requirements for NHS-Digital data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 9
- Files released
- 9
Datasets: Birth Notification Data; Emergency Care Data Set (ECDS); HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES-ID to MPS-ID HES Outpatients; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5
What changed from DARS-NIC-175120-W5G2X-v11.2
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2023-10-18 | |
| End date | 2025-03-31 |
Objective for processing
[101 paragraphs unchanged]
d. ONS will use this data in conjunction with other health sources, and non-health sources such as Census, income and benefits data, and survey data, to produce a range of statistics on the interaction between health and the labour market. This is bi-directional, looking both at how health affects economic outcomes and vice versa. Work would include but not be limited to:
• Producing statistics on the prevalence of conditions in people who are inactive in the labour market due to ill health
• Modelling whether a change in the prevalence of certain conditions explain part of the increase in labour market inactivity observed since 2019.
[24 paragraphs unchanged]
ONS also needs hospital data from during the UK epidemic to have
[15 words unchanged]
of HES data will provide ONS with this information much sooner than
an annual supply would provide.
A separate Agreement (DARS-NIC-400304-S1P1B) has now been set up to cover this area of work related to rapid response COVID-19 analysis and additional data beyond that covered in this Agreement such as primary care data and any additional statistical research projects will be updated through that Agreement. The Agreement, DARS-NIC-400304-S1P1B, includes permission to reuse some of the data acquired through this Agreement and to link this data to other sources as specified in that Agreement.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new Official Statistics.
Changed only in punctuation, spacing or capitalisation: Processing activities.
Unchanged: Expected output, Expected measurable benefits.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS England, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://www.statisticsauthority.gov.uk/publication/delivering-better-statistics-for-better-decisions-data-access-legislation-march-2016/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this Agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this Data Sharing Agreement. This process involved working closely with NHS England’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS England will also publish the details of this Data Sharing Agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this Agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS England approval. It would also require an appropriate alternative legal gateway because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS England and enter into an amended Data Sharing Agreement before proceeding with that new purpose.
Dataset 1: Birth Notifications data
NHS England has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
There are a wide range of statistical uses to which the Office for National Statistics (ONS) intends to put Birth Notifications data. All use of Birth Notifications data by ONS will be to improve the availability and quality of statistics as part of ONS’s function to produce statistics for the public good.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required.
1.1 Birth and Child Mortality Statistics
The primary statistical purpose for which this information will be used is analysis of births, maternities, infant mortality and child health outcomes. Analyses are made publicly available as aggregate National Statistics.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics. However, there are some limitations with the GRO data, including a time lag, a lack of key information such as length of gestation and ethnicity of the baby, as well as some missing values in the fields that are available. To mitigate these limitations, the NHS England birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. The identifying information required from NHS England will enable and help quality assure this linkage, which in turn will enable ONS to produce more comprehensive and accurate statistics on births and child health outcomes.
As well as linking birth notifications data to birth registrations and deaths data to produce National Statistics these data will also be linked to other sources in order improve and development new statistics. For example, birth notifications data will be linked to:
• birth registration, deaths and census data to identify more detailed characteristics of the household and mother, such as ethnicity, and so better understand inequalities, risk factors and variation in child health outcomes
• deaths, to identify bereaved children, and to other NHS England data to identify subsequent inequalities and outcomes
• other ONS and NHS England data such as Hospital Episode Statistics to better determine underlying cause of death, understand inequalities, risk factors and variation in child outcomes
1.2 Improving data linkage methodology
ONS plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link information relating to siblings born at different times (i.e. not twins) using NHS number of the mother. This produces very accurate linkage of siblings.
ONS can then attempt to link siblings together using only the data available in the registration data – i.e. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the results of the latter linkage method matches those achieved when linking using mother’s NHS number. This will inform the best matching methodology to use when NHS number of the mother is not available (for example in pre-2005 birth registration data).
1.3 Improving population and migration statistics
ONS plans to use births notifications data to support development and improvements of population and migration statistics. This includes a range of work such as quality assurance of Census data, contribution to ONS’s population and migration statistics transformation programme, to put administrative data first and make recommendations on the future of the decennial Census. For example, birth notifications data will be:
• used to validate Census data, with a focus on population sub-groups, such as the under 1s, returned in Census data and subsequently supporting population outputs
• used to contribute to work to estimate or quality assure characteristics of the population, such as ethnicity or age, along with other data sources
• linked to other data sources in order to carry out such improvements to existing or develop new Official Statistics, and to quality assurance other data sources
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – e.g. additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – e.g. where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
• Research and development of methodology – e.g. improving linkage methodology for siblings
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS England data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realised.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity Data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity, but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data-based ethnicity estimates will be important when deciding whether to move to an admin data-based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS England data experts to understand the limitations of the HES ethnicity data and there are several; for example, coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about when, where, and why people have accessed hospital services, for example diagnosis and procedures codes, for a range of statistical purposes in line with ONS’s function to produce statistics for the public good. All use of the HES data for health analysis will be to improve the availability and quality of health statistics.
The diagnosis and procedures information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, for the first supply of HES data to ONS the volume of this information was minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services was shared with ONS, compared with the information about when and where people have accessed services. ONS has now used and published analysis using these HES data for several purposes described in this Agreement and DARS-NIC-400304-S1P1B (which allows reuse of the HES data ONS hold). Based on learning from this work ONS are now requesting further additional variables and historical times series updates where some variables were only requested for a subset of years to the current HES subset they receive.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
(i) Understanding healthy life expectancy.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
(ii) Understanding health inequalities.
Inclusion is one of the 4 pillars of the ONS strategy ‘Statistics for the Public Good’, as such exploring inequalities across outcomes is a priority for the ONS. Making use of linked morbidity, mortality, census and other data will allow ONS to produce statistics on health inequalities and provide these at a granular level. In particular, linking to these health data will help ONS to better understand if inequalities in outcomes persist when health status or pre-existing conditions are taken into account. For example, ONS have already used HES data to understand comorbidities of the population and to take this into account when modelling the risk of COVID-19 deaths by ethnicity (under DARS-NIC-400304-S1P1B). This allowed ONS to provide evidence that inequalities in outcomes still exist despite controlling for certain, but not all, health conditions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly.
It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible, to develop new measures of avoidable mortality in the elderly that could have been avoided.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality.
The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
d. ONS will use this data in conjunction with other health sources, and non-health sources such as Census, income and benefits data, and survey data, to produce a range of statistics on the interaction between health and the labour market. This is bi-directional, looking both at how health affects economic outcomes and vice versa. Work would include but not be limited to:
• Producing statistics on the prevalence of conditions in people who are inactive in the labour market due to ill health
• Modelling whether a change in the prevalence of certain conditions explain part of the increase in labour market inactivity observed since 2019.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation, and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, new-born and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS England and UK Health Security Agency (UKHSA) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability, and geography. In some cases, NHS England / UKHSA will not hold data that would enable this but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken by central government, health services and others.
ONS previously held HES data covering up until March 2019 and was to receive annual updates. This is not timely enough to enable all of the aims of the project. The gap in HES data between April 2019 to February 2020 (from before the UK epidemic) means ONS did not have an up-to-date picture of underlying health conditions. Getting retrospective monthly HES data for this period will fill this gap sooner than waiting for the final annual 2019/20 extract which will be supplied by NHSD in October 2020.
ONS also needs hospital data from during the UK epidemic to have visibility of those who are hospitalised from COVID-19 but then recover. An ongoing monthly supply of HES data will provide ONS with this information much sooner than
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is usually released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released over the year in a series of themed packages. Child and infant mortality statistics and unexplained infant deaths are published annually. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
ONS are looking to improve and develop new statistics using newly linked data to explore inequalities, risk factors and variation in child outcomes. Outputs in the form of presentations, analytical articles and methodology reports will be created alongside data tables as appropriate. ONS publishes all its official statistics on its website.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Improving population and migration statistics: This will result in internal, and potentially external, ONS reports and presentations on how births notification data could be used to improve and develop official statistics, and potentially used directly in the development of new official statistics. ONS publishes all its official statistics on its website.
Dataset 2, 3 and 4: Hospital Episode Statistics, Improving Access to Psychological Therapies and Emergency Care Dataset data
The initial uses to which ONS will put HES, IAPT and ECDS data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Initial work has been carried out and new statistics published using HES data as part of the response to the coronavirus pandemic which has assured ONS of the quality and validity of using these data as initially intended such that additional data is being requested as part of this Agreement to address limitations in the initial supply of HES data. Research outputs have been published on the ONS website, for example: https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/updatingethniccontrastsindeathsinvolvingthecoronaviruscovid19englandandwales/deathsoccurring2marchto28july2020
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES, IAPT or ECDS data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users and will seek to provide frequent updates on these projects during that first stage.
DARS-NIC-175120-W5G2X-v11.2 9 June 2023 to 30 September 2023
- Title
- D5 - Office for National Statistics requirements for NHS-Digital data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 9
- Files released
- 15
Datasets: Birth Notification Data; Emergency Care Data Set (ECDS); HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES-ID to MPS-ID HES Outpatients; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5
What changed from DARS-NIC-175120-W5G2X-v10.3
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2023-06-09 |
Objective for processing
[27 paragraphs unchanged]
Using robust information governance processes, ONS has determined that the conditions associated
[6 words unchanged]
of the amended SRSA have been met for the information in this
data sharing agreement.
Data Sharing Agreement.
This process involved working closely with NHS England’s experts to help determine
[69 words unchanged]
acquiring the information, and ONS notes that NHS England will also publish
the details of
this
data sharing agreement.
Data Sharing Agreement.
[100 paragraphs unchanged]
2.7. Productivi
Changed only in punctuation, spacing or capitalisation: Expected output.
Unchanged: Processing activities, Expected measurable benefits.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS England, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://www.statisticsauthority.gov.uk/publication/delivering-better-statistics-for-better-decisions-data-access-legislation-march-2016/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this Agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this Data Sharing Agreement. This process involved working closely with NHS England’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS England will also publish the details of this Data Sharing Agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this Agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS England approval. It would also require an appropriate alternative legal gateway because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS England and enter into an amended Data Sharing Agreement before proceeding with that new purpose.
Dataset 1: Birth Notifications data
NHS England has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
There are a wide range of statistical uses to which the Office for National Statistics (ONS) intends to put Birth Notifications data. All use of Birth Notifications data by ONS will be to improve the availability and quality of statistics as part of ONS’s function to produce statistics for the public good.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required.
1.1 Birth and Child Mortality Statistics
The primary statistical purpose for which this information will be used is analysis of births, maternities, infant mortality and child health outcomes. Analyses are made publicly available as aggregate National Statistics.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics. However, there are some limitations with the GRO data, including a time lag, a lack of key information such as length of gestation and ethnicity of the baby, as well as some missing values in the fields that are available. To mitigate these limitations, the NHS England birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. The identifying information required from NHS England will enable and help quality assure this linkage, which in turn will enable ONS to produce more comprehensive and accurate statistics on births and child health outcomes.
As well as linking birth notifications data to birth registrations and deaths data to produce National Statistics these data will also be linked to other sources in order improve and development new statistics. For example, birth notifications data will be linked to:
• birth registration, deaths and census data to identify more detailed characteristics of the household and mother, such as ethnicity, and so better understand inequalities, risk factors and variation in child health outcomes
• deaths, to identify bereaved children, and to other NHS England data to identify subsequent inequalities and outcomes
• other ONS and NHS England data such as Hospital Episode Statistics to better determine underlying cause of death, understand inequalities, risk factors and variation in child outcomes
1.2 Improving data linkage methodology
ONS plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link information relating to siblings born at different times (i.e. not twins) using NHS number of the mother. This produces very accurate linkage of siblings.
ONS can then attempt to link siblings together using only the data available in the registration data – i.e. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the results of the latter linkage method matches those achieved when linking using mother’s NHS number. This will inform the best matching methodology to use when NHS number of the mother is not available (for example in pre-2005 birth registration data).
1.3 Improving population and migration statistics
ONS plans to use births notifications data to support development and improvements of population and migration statistics. This includes a range of work such as quality assurance of Census data, contribution to ONS’s population and migration statistics transformation programme, to put administrative data first and make recommendations on the future of the decennial Census. For example, birth notifications data will be:
• used to validate Census data, with a focus on population sub-groups, such as the under 1s, returned in Census data and subsequently supporting population outputs
• used to contribute to work to estimate or quality assure characteristics of the population, such as ethnicity or age, along with other data sources
• linked to other data sources in order to carry out such improvements to existing or develop new Official Statistics, and to quality assurance other data sources
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – e.g. additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – e.g. where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
• Research and development of methodology – e.g. improving linkage methodology for siblings
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS England data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realised.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity Data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity, but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data-based ethnicity estimates will be important when deciding whether to move to an admin data-based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS England data experts to understand the limitations of the HES ethnicity data and there are several; for example, coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about when, where, and why people have accessed hospital services, for example diagnosis and procedures codes, for a range of statistical purposes in line with ONS’s function to produce statistics for the public good. All use of the HES data for health analysis will be to improve the availability and quality of health statistics.
The diagnosis and procedures information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, for the first supply of HES data to ONS the volume of this information was minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services was shared with ONS, compared with the information about when and where people have accessed services. ONS has now used and published analysis using these HES data for several purposes described in this Agreement and DARS-NIC-400304-S1P1B (which allows reuse of the HES data ONS hold). Based on learning from this work ONS are now requesting further additional variables and historical times series updates where some variables were only requested for a subset of years to the current HES subset they receive.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
(i) Understanding healthy life expectancy.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
(ii) Understanding health inequalities.
Inclusion is one of the 4 pillars of the ONS strategy ‘Statistics for the Public Good’, as such exploring inequalities across outcomes is a priority for the ONS. Making use of linked morbidity, mortality, census and other data will allow ONS to produce statistics on health inequalities and provide these at a granular level. In particular, linking to these health data will help ONS to better understand if inequalities in outcomes persist when health status or pre-existing conditions are taken into account. For example, ONS have already used HES data to understand comorbidities of the population and to take this into account when modelling the risk of COVID-19 deaths by ethnicity (under DARS-NIC-400304-S1P1B). This allowed ONS to provide evidence that inequalities in outcomes still exist despite controlling for certain, but not all, health conditions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly.
It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible, to develop new measures of avoidable mortality in the elderly that could have been avoided.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality.
The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation, and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, new-born and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS England and UK Health Security Agency (UKHSA) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability, and geography. In some cases, NHS England / UKHSA will not hold data that would enable this but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken by central government, health services and others.
ONS previously held HES data covering up until March 2019 and was to receive annual updates. This is not timely enough to enable all of the aims of the project. The gap in HES data between April 2019 to February 2020 (from before the UK epidemic) means ONS did not have an up-to-date picture of underlying health conditions. Getting retrospective monthly HES data for this period will fill this gap sooner than waiting for the final annual 2019/20 extract which will be supplied by NHSD in October 2020.
ONS also needs hospital data from during the UK epidemic to have visibility of those who are hospitalised from COVID-19 but then recover. An ongoing monthly supply of HES data will provide ONS with this information much sooner than an annual supply would provide.
A separate Agreement (DARS-NIC-400304-S1P1B) has now been set up to cover this area of work related to rapid response COVID-19 analysis and additional data beyond that covered in this Agreement such as primary care data and any additional statistical research projects will be updated through that Agreement. The Agreement, DARS-NIC-400304-S1P1B, includes permission to reuse some of the data acquired through this Agreement and to link this data to other sources as specified in that Agreement.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new Official Statistics.
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is usually released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released over the year in a series of themed packages. Child and infant mortality statistics and unexplained infant deaths are published annually. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
ONS are looking to improve and develop new statistics using newly linked data to explore inequalities, risk factors and variation in child outcomes. Outputs in the form of presentations, analytical articles and methodology reports will be created alongside data tables as appropriate. ONS publishes all its official statistics on its website.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Improving population and migration statistics: This will result in internal, and potentially external, ONS reports and presentations on how births notification data could be used to improve and develop official statistics, and potentially used directly in the development of new official statistics. ONS publishes all its official statistics on its website.
Dataset 2, 3 and 4: Hospital Episode Statistics, Improving Access to Psychological Therapies and Emergency Care Dataset data
The initial uses to which ONS will put HES, IAPT and ECDS data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Initial work has been carried out and new statistics published using HES data as part of the response to the coronavirus pandemic which has assured ONS of the quality and validity of using these data as initially intended such that additional data is being requested as part of this Agreement to address limitations in the initial supply of HES data. Research outputs have been published on the ONS website, for example: https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/updatingethniccontrastsindeathsinvolvingthecoronaviruscovid19englandandwales/deathsoccurring2marchto28july2020
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES, IAPT or ECDS data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users and will seek to provide frequent updates on these projects during that first stage.
DARS-NIC-175120-W5G2X-v10.3 17 March 2023 to 30 September 2023
- Title
- D5 - Office for National Statistics requirements for NHS-Digital data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 9
- Files released
- 10
Datasets: Birth Notification Data; Emergency Care Data Set (ECDS); HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES-ID to MPS-ID HES Outpatients; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5
What changed from DARS-NIC-175120-W5G2X-v9.2
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2023-03-17 | |
| End date | 2023-09-30 |
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS
Digital,
England,
for the production of official statistics.
[7 paragraphs unchanged]
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding
[12 words unchanged]
where serving public good includes informing the public about social and economic
matters,
matters
and assisting in the development and evaluation of public policy’. It also
[33 words unchanged]
any matter relating to the United Kingdom or any part of it’.
[18 paragraphs unchanged]
Using robust information governance processes, ONS has determined that the conditions associated
[16 words unchanged]
in this data sharing agreement. This process involved working closely with NHS
Digital’s
England’s
experts to help determine that the data would likely be of good
[21 words unchanged]
powers – for example whether sharing the data is in the public
interest,
interest
and proportionate in terms of burden on the supplier. In addition, as
[11 words unchanged]
of the reasons for acquiring the information, and ONS notes that NHS
Digital
England
will also publish this data sharing agreement.
[1 paragraph unchanged]
The data shared with ONS under this agreement will not be onwardly
[23 words unchanged]
Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS
Digital
England
approval. It would also require an appropriate alternative legal
gateway,
gateway
because section 45c of the SRSA as amended by the Digital Economy
[6 words unchanged]
shared with ONS (not for example, other Government departments or academic researchers).
[1 paragraph unchanged]
In future, ONS may decide to put a dataset to new uses
[10 words unchanged]
be in line with ONS’s legally defined functions. ONS will inform NHS
Digital
England
and enter into an amended Data Sharing Agreement before proceeding with that new
purpose .
purpose.
[1 paragraph unchanged]
NHS
Digital
England
has disseminated birth notifications data to ONS since 2005. Support under section
[22 words unchanged]
to flow will change to section 45c of the amended SRSA 2007.
[4 paragraphs unchanged]
Birth registration data that ONS receives from the General Register Office (GRO)
[42 words unchanged]
in the fields that are available. To mitigate these limitations, the NHS
Digital
England
birth notifications data are used to improve and validate the registration data.
[9 words unchanged]
be linked at an individual level. The identifying information required from NHS
Digital
England
will enable and help quality assure this linkage, which in turn will enable ONS to produce more comprehensive and accurate statistics on births and child health outcomes.
[2 paragraphs unchanged]
• deaths, to identify bereaved children, and to other NHS
digital
England
data to identify subsequent inequalities and outcomes
• other ONS and NHS
digital
England
data such as Hospital Episode Statistics to better determine underlying cause of death, understand inequalities, risk factors and variation in child outcomes
[15 paragraphs unchanged]
The specification of the variables being required has been developed in collaboration with NHS
Digital
England
data experts to ensure the data being shared are of sufficient quality
[11 words unchanged]
purpose intended. The proposed uses of the HES data are as follows.
[1 paragraph unchanged]
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be
realized.
realised.
[8 paragraphs unchanged]
Ethnicity and national identity received one of the highest user needs scores
[27 words unchanged]
authorities make changes to service delivery. The traditional census includes questions on
ethnicity
ethnicity,
but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin
data based
data-based
ethnicity estimates will be important when deciding whether to move to an admin
data based
data-based
census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on
[11 words unchanged]
the few sources where ethnicity is captured. ONS has worked with NHS
Digital
England
data experts to understand the limitations of the HES ethnicity data and there are several; for
example
example,
coverage and differences between the ethnicity categories used on HES vs on
[22 words unchanged]
is in the public interest this ethnicity information is acquired from HES.
[7 paragraphs unchanged]
ONS’s health analysts will use information about when,
where
where,
and why people have accessed hospital services, for example diagnosis and procedures
[27 words unchanged]
analysis will be to improve the availability and quality of health statistics.
[15 paragraphs unchanged]
ONS holds data from the compulsory registration of all deaths in England
[25 words unchanged]
which the data can be put. The majority of deaths occur in
hospital,
hospital
or following an illness for which the deceased had hospital treatment. Linking
[8 words unchanged]
causes of death will allow exploration of the relationships between them, including:
[1 paragraph unchanged]
It is well-known that deaths of elderly people tend to mention more
[79 words unchanged]
pneumonia and sepsis in the causal pathways leading to death, and if
possible
possible,
to develop new measures of avoidable mortality in the elderly that could have been avoided.
[5 paragraphs unchanged]
This project will investigate using HES data to identify and/or validate the addresses of communal
establishments,
establishments
and would require information including where individuals were admitted from and discharged to. Also:
[4 paragraphs unchanged]
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption,
accumulation
accumulation,
and wealth.
[10 paragraphs unchanged]
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal,
newborn
new-born
and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS
Digital
England
and
Public
UK
Health
England (PHE)
Security Agency (UKHSA)
to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex,
disability
disability,
and geography. In some cases, NHS
Digital
England
/
PHE
UKHSA
will not hold data that would enable
this,
this
but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
[4 paragraphs unchanged]
ONS previously held HES data covering up until March 2019 and was
[28 words unchanged]
2020 (from before the UK epidemic) means ONS did not have an
up to date
up-to-date
picture of underlying health conditions. Getting retrospective monthly HES data for this
[11 words unchanged]
annual 2019/20 extract which will be supplied by NHSD in October 2020.
[3 paragraphs unchanged]
2.7.
Productivity
Productivi
To f
Processing activities
[1 paragraph unchanged]
ONS receives the data in real time through its Spine2 connection from NHS
Digital.
England.
It arrives as
xml
.xml
files which are converted on a secure WebLogic server before being transferred
[16 words unchanged]
is separate to those which are used for other datasets from NHS
Digital,
England,
due to the long-standing nature of this data share.
The birth notifications data are linked with ONS’s birth registrations data at an individual level. Where possible, NHS number of baby and/or mother are used. In some
cases
cases,
this will fail, for example when the same NHS number is used
[36 words unchanged]
number of cases, clerical matching is required. Only a small number of
security
securities
cleared, trained, substantive ONS employees are involved with this part of the process.
[24 paragraphs unchanged]
With reasonable notice, periodic written/verbal checks may be conducted by an authorised employee of NHS
Digital
England
to confirm compliance with this application.
ONS will keep a record of any processing of Personal Data and will provide a copy of such record to NHS
Digital
England
on request. ONS will not transfer or permit the transfer of the Data to any territory outside the UK without the prior written consent of NHS
Digital.
England.
[2 paragraphs unchanged]
ONS will never seek to intentionally re-identify this data. ONS staff are suitably trained; for
example
example,
ONS’s health analysts in particular are experienced working with sensitive data about
[25 words unchanged]
other words, other than the initial transfer of the data from NHS
Digital
England
to ONS, the identifiable data will never be in transit and will always be protected by procedural controls in place now
[7 paragraphs unchanged]
There are additional characteristics that should be considered when thinking about quality. These include output quality trade-offs, user needs and perceptions, performance cost and respondent burden, and confidentiality,
transparency
transparency,
and security.’
The clearest example of the need for the information in this agreement
[32 words unchanged]
and products that cover the whole of England (and beyond), so complete
BN,
Birth Notifications,
HES, ECDS and IAPT coverage is required. In addition, a decision is
[62 words unchanged]
them to the gold standard Census figures available for 2011 and 2021.
For the health analysis purposes presented in section 5a that require why
[39 words unchanged]
complex than a lot of the other proposed uses and require more
ground work
groundwork
to determine whether statistics of sufficient quality can be produced. In addition,
[15 words unchanged]
determined that it was proportionate and in the public interest that the
years
years’
worth of HES diagnosis information required was minimised. Following analysis using these
[17 words unchanged]
of diagnosis codes previously received as well as requiring additional procedure codes.
Analysis using diagnosis information has proved successful in understanding and controlling for
[45 words unchanged]
number of years of data available and the breadth of variables. For
APC
Admitted Patient Care (APC)
&
OP,
Outpatients (OP),
ONS has identified further that procedure codes are also required to ensure
[5 words unchanged]
of risk predictors and capture important clinical events following discharge from hospital.
[1 paragraph unchanged]
Access to data held within the Data Access Platform (DAP), which includes
BN,
Birth Notifications,
HES, ECDS and IAPT data, is granted to users on a need-to-know
[80 words unchanged]
HES data, with regular audit and monitoring in place to ensure compliance.
Expected output
[7 paragraphs unchanged]
The initial uses to which ONS will put
HES,IAPT
HES, IAPT
and ECDS data are most commonly new or improved official statistics that
[28 words unchanged]
whether official statistics of sufficient quality can be produced in each case.
[7 paragraphs unchanged]
No targets can be given as to if and when experimental or
[16 words unchanged]
any given project is complete. All ONS statistical teams engage regularly with
users,
users
and will seek to provide frequent updates on these projects during that first stage.
Expected measurable benefits
As per section 5a, the legal gateway under which data will flow from NHS
Digital
England
to ONS will be Section 45c of the SRSA 2007 (as amended
[29 words unchanged]
in line with the statistical statement of principles that underpins these powers.
These considerations include that the purposes to which ONS puts the data
[27 words unchanged]
care specifically. This is unlike some other legal gateways under which NHS
Digital
England
data can be disseminated, for example section 251 of the NHS Act 2006, when research outcomes must benefit health and social care.
[3 paragraphs unchanged]
Other users of births, child and infant mortality and child outcome statistics include academics,
demographers
demographers,
and health researchers, who conduct research into trends and characteristics. Lobby groups
[90 words unchanged]
for international comparison purposes. The media also report on trends and statistics.
[1 paragraph unchanged]
In addition, they are used as the denominator in any statistics that
[61 words unchanged]
used to better target age and sex specific health and care services
(e.g.
(e.g.,
maternity, aging populations etc)
[26 paragraphs unchanged]
The UK was at the forefront of developing the United Nations recognized Sustainable Development Goals (SDGs). ONS aims to fully report UK progress against these goals
(i.e.
(i.e.,
have data available for the SDG indicators that have been proposed), given
[6 words unchanged]
SDG development, and wants to continue to show leadership in this space.
[2 paragraphs unchanged]
2.6 Benefits of supporting Covid-19 analysis
Analysis of the impact of having had COVID-19 and the impact of the pandemic on society, the economy and the environment will enable the government to better respond to the ongoing public health crisis, for example through tailored public health interventions.
This analysis is of national public health importance and has been requested by central government leaders and advisors such as SAGE and the government, via the National Statistician. The results of the analysis will be used to inform members of SAGE, Members of Parliament (MPs) and other government officials of the differing COVID-19 risk profiles experienced by UK citizens. These statistics will enable the government to refine its policy response to the pandemic using the best evidence available.
The analysis may also improve the public’s understanding of the risk faced by certain population groups, leading to more informed decision making, and add to the growing body of literature being produced and evaluated by the global academic community. Ultimately this analysis has the potential to deliver public health benefit by reducing COVID-19 related mortality and morbidity in the UK, and potentially saving lives.
[14 paragraphs unchanged]
Dataset 4: Predicted Benefits of the uses for ECDS data
Again, as ECDS is replacing the HES A&E data, the benefits described for HES data in section 2 will also apply to ECDS data.
In addition to the those described in section 2, ECDS data would also have an additional benefits as follows:
4.1. Benefits of using ECDS data for Crime Statistics (including knife and drug related crime)
There has been recognition, both nationally and internationally, of the benefit of the use of data collected by emergency departments for informing violence and injury prevention. The ONS Centre for Crime and Justice are carrying out exploratory analysis to improve the statistical evidence base on violent crime.
The ECDS data are used to address two key aims:
1. To explore the usefulness and feasibility of using urgent and emergency care attendance data to further understand the impact of violent crime on services (crime harm) within crime statistics
2. To explore the usefulness and feasibility of using urgent and emergency care attendance to further understand the specific impact of domestic violence on services
Both strands of the project are with public benefit in mind.
The Crime Harm strand is aimed at exploring and proposing a new, improved way of measuring crime harm. The new tool has a potential to be a more innovative, reliable, and inclusive measure of crime harm. An improved, more nuanced tool could have a range of positive impacts including better, more targeted allocation of police resources, more cost-effective public services expenditure, further research contributing to the current evidence base related to crime harm.
The domestic violence strand work can potentially help inform interventions and crime prevention work. Analysing data from the ECDS could help inform local and government policy, which in turn could reduce the numbers of assault victims. This would be of benefit for emergency departments and the NHS, in terms of reducing burden and would have cost savings. The ECDS data as a supplement to the CSEW domestic violence data can also help to give a more comprehensive and accurate picture of domestic violence in the UK and contribute to better monitoring of domestic violence rates and the progress towards the Sustainable Development Goals.
4.2 Waiting time on Mortality
This research aims to investigate the effect of hospital waiting time in Emergency Departments (EDs) on mortality. Whilst ONS conducted initial analyses using aggregated data at the Integrated Care Board (ICB) level, data aggregation prevents ONS from investigating finer trends unique to individual patients and their care journeys through EDs.
Previous studies explore patient outcomes following ED attendance controlling for individual level characteristics, including age, sex, comorbidities, deprivation and history of ED attendance / emergency admission.
Therefore essential aspects of understanding patient level outcome must include:
• Comorbidities: comorbidities are a measure of patient’s disease complexity. A patient’s comorbidity is an important confounder to control for, to exclude possibilities of selection bias in ED (ie, sicker patients waiting longer because they take more time to treat). Sicker patients may also be more likely to die, irrespective of waiting time.
• Acuity & diagnosis code: a patient’s acuity is another essential confounder to control for which is not captured by comorbidity. It enables to adjust for non-linear relationships between waiting time and mortality: ie, whilst a patient with an acute condition has higher chances of death, acute conditions are likely to be picked up faster in ED due to triage. It is essential to understand triage effects to understand in which case increased waiting time may impact mortality. Acuity has not been included in previous study designs and would represent an important improvement.
To provide continuity of information, replicate and improve on previous studies, it is essential that our research include these variables in the statistical modelling. The quality of ONS's findings would be jeopardized without these metric, as it is critical to disentangle what effect hospital waiting time is having on patient outcomes without over-simplifying trends. The highest risk ONS could incur in this scenario is to make policy recommendations which would have no impact on patient’s outcomes.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS England, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://www.statisticsauthority.gov.uk/publication/delivering-better-statistics-for-better-decisions-data-access-legislation-march-2016/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this data sharing agreement. This process involved working closely with NHS England’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS England will also publish this data sharing agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS England approval. It would also require an appropriate alternative legal gateway because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS England and enter into an amended Data Sharing Agreement before proceeding with that new purpose.
Dataset 1: Birth Notifications data
NHS England has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
There are a wide range of statistical uses to which the Office for National Statistics (ONS) intends to put Birth Notifications data. All use of Birth Notifications data by ONS will be to improve the availability and quality of statistics as part of ONS’s function to produce statistics for the public good.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required.
1.1 Birth and Child Mortality Statistics
The primary statistical purpose for which this information will be used is analysis of births, maternities, infant mortality and child health outcomes. Analyses are made publicly available as aggregate National Statistics.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics. However, there are some limitations with the GRO data, including a time lag, a lack of key information such as length of gestation and ethnicity of the baby, as well as some missing values in the fields that are available. To mitigate these limitations, the NHS England birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. The identifying information required from NHS England will enable and help quality assure this linkage, which in turn will enable ONS to produce more comprehensive and accurate statistics on births and child health outcomes.
As well as linking birth notifications data to birth registrations and deaths data to produce National Statistics these data will also be linked to other sources in order improve and development new statistics. For example, birth notifications data will be linked to:
• birth registration, deaths and census data to identify more detailed characteristics of the household and mother, such as ethnicity, and so better understand inequalities, risk factors and variation in child health outcomes
• deaths, to identify bereaved children, and to other NHS England data to identify subsequent inequalities and outcomes
• other ONS and NHS England data such as Hospital Episode Statistics to better determine underlying cause of death, understand inequalities, risk factors and variation in child outcomes
1.2 Improving data linkage methodology
ONS plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link information relating to siblings born at different times (i.e. not twins) using NHS number of the mother. This produces very accurate linkage of siblings.
ONS can then attempt to link siblings together using only the data available in the registration data – i.e. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the results of the latter linkage method matches those achieved when linking using mother’s NHS number. This will inform the best matching methodology to use when NHS number of the mother is not available (for example in pre-2005 birth registration data).
1.3 Improving population and migration statistics
ONS plans to use births notifications data to support development and improvements of population and migration statistics. This includes a range of work such as quality assurance of Census data, contribution to ONS’s population and migration statistics transformation programme, to put administrative data first and make recommendations on the future of the decennial Census. For example, birth notifications data will be:
• used to validate Census data, with a focus on population sub-groups, such as the under 1s, returned in Census data and subsequently supporting population outputs
• used to contribute to work to estimate or quality assure characteristics of the population, such as ethnicity or age, along with other data sources
• linked to other data sources in order to carry out such improvements to existing or develop new Official Statistics, and to quality assurance other data sources
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – e.g. additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – e.g. where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
• Research and development of methodology – e.g. improving linkage methodology for siblings
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS England data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realised.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity Data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity, but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data-based ethnicity estimates will be important when deciding whether to move to an admin data-based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS England data experts to understand the limitations of the HES ethnicity data and there are several; for example, coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about when, where, and why people have accessed hospital services, for example diagnosis and procedures codes, for a range of statistical purposes in line with ONS’s function to produce statistics for the public good. All use of the HES data for health analysis will be to improve the availability and quality of health statistics.
The diagnosis and procedures information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, for the first supply of HES data to ONS the volume of this information was minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services was shared with ONS, compared with the information about when and where people have accessed services. ONS has now used and published analysis using these HES data for several purposes described in this agreement and DARS-NIC-400304-S1P1B (which allows reuse of the HES data ONS hold). Based on learning from this work ONS are now requesting further additional variables and historical times series updates where some variables were only requested for a subset of years to the current HES subset they receive.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
(i) Understanding healthy life expectancy.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
(ii) Understanding health inequalities.
Inclusion is one of the 4 pillars of the ONS strategy ‘Statistics for the Public Good’, as such exploring inequalities across outcomes is a priority for the ONS. Making use of linked morbidity, mortality, census and other data will allow ONS to produce statistics on health inequalities and provide these at a granular level. In particular, linking to these health data will help ONS to better understand if inequalities in outcomes persist when health status or pre-existing conditions are taken into account. For example, ONS have already used HES data to understand comorbidities of the population and to take this into account when modelling the risk of COVID-19 deaths by ethnicity (under DARS-NIC-400304-S1P1B). This allowed ONS to provide evidence that inequalities in outcomes still exist despite controlling for certain, but not all, health conditions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly.
It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible, to develop new measures of avoidable mortality in the elderly that could have been avoided.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality.
The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation, and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, new-born and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS England and UK Health Security Agency (UKHSA) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability, and geography. In some cases, NHS England / UKHSA will not hold data that would enable this but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken by central government, health services and others.
ONS previously held HES data covering up until March 2019 and was to receive annual updates. This is not timely enough to enable all of the aims of the project. The gap in HES data between April 2019 to February 2020 (from before the UK epidemic) means ONS did not have an up-to-date picture of underlying health conditions. Getting retrospective monthly HES data for this period will fill this gap sooner than waiting for the final annual 2019/20 extract which will be supplied by NHSD in October 2020.
ONS also needs hospital data from during the UK epidemic to have visibility of those who are hospitalised from COVID-19 but then recover. An ongoing monthly supply of HES data will provide ONS with this information much sooner than an annual supply would provide.
A separate agreement (DARS-NIC-400304-S1P1B) has now been set up to cover this area of work related to rapid response COVID-19 analysis and additional data beyond that covered in this agreement such as primary care data and any additional statistical research projects will be updated through that agreement. The agreement, DARS-NIC-400304-S1P1B, includes permission to reuse some of the data acquired through this agreement and to link this data to other sources as specified in that agreement.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new Official Statistics.
2.7. Productivi
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is usually released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released over the year in a series of themed packages. Child and infant mortality statistics and unexplained infant deaths are published annually. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
ONS are looking to improve and develop new statistics using newly linked data to explore inequalities, risk factors and variation in child outcomes. Outputs in the form of presentations, analytical articles and methodology reports will be created alongside data tables as appropriate. ONS publishes all its official statistics on its website.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Improving population and migration statistics: This will result in internal, and potentially external, ONS reports and presentations on how births notification data could be used to improve and develop official statistics, and potentially used directly in the development of new official statistics. ONS publishes all its official statistics on its website.
Dataset 2, 3 and 4: Hospital Episode Statistics, Improving Access to Psychological Therapies and Emergency Care Dataset data
The initial uses to which ONS will put HES, IAPT and ECDS data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Initial work has been carried out and new statistics published using HES data as part of the response to the coronavirus pandemic which has assured ONS of the quality and validity of using these data as initially intended such that additional data is being requested as part of this agreement to address limitations in the initial supply of HES data. Research outputs have been published on the ONS website, for example: https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/updatingethniccontrastsindeathsinvolvingthecoronaviruscovid19englandandwales/deathsoccurring2marchto28july2020
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES, IAPT or ECDS data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users and will seek to provide frequent updates on these projects during that first stage.
DARS-NIC-175120-W5G2X-v9.2 29 July 2022 to 31 March 2023
- Title
- D5 - Office for National Statistics requirements for NHS-Digital data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 9
- Files released
- 118
Datasets: Birth Notification Data; Emergency Care Data Set (ECDS); HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES-ID to MPS-ID HES Outpatients; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5
What changed from DARS-NIC-175120-W5G2X-v8.4
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2022-07-29 | |
| End date | 2023-03-31 |
Unchanged: Objective for processing, Processing activities, Expected output, Expected measurable benefits.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS Digital, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://www.statisticsauthority.gov.uk/publication/delivering-better-statistics-for-better-decisions-data-access-legislation-march-2016/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters, and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this data sharing agreement. This process involved working closely with NHS Digital’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest, and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS Digital will also publish this data sharing agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS Digital approval. It would also require an appropriate alternative legal gateway, because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS Digital and enter into an amended Data Sharing Agreement before proceeding with that new purpose .
Dataset 1: Birth Notifications data
NHS Digital has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
There are a wide range of statistical uses to which the Office for National Statistics (ONS) intends to put Birth Notifications data. All use of Birth Notifications data by ONS will be to improve the availability and quality of statistics as part of ONS’s function to produce statistics for the public good.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required.
1.1 Birth and Child Mortality Statistics
The primary statistical purpose for which this information will be used is analysis of births, maternities, infant mortality and child health outcomes. Analyses are made publicly available as aggregate National Statistics.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics. However, there are some limitations with the GRO data, including a time lag, a lack of key information such as length of gestation and ethnicity of the baby, as well as some missing values in the fields that are available. To mitigate these limitations, the NHS Digital birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. The identifying information required from NHS Digital will enable and help quality assure this linkage, which in turn will enable ONS to produce more comprehensive and accurate statistics on births and child health outcomes.
As well as linking birth notifications data to birth registrations and deaths data to produce National Statistics these data will also be linked to other sources in order improve and development new statistics. For example, birth notifications data will be linked to:
• birth registration, deaths and census data to identify more detailed characteristics of the household and mother, such as ethnicity, and so better understand inequalities, risk factors and variation in child health outcomes
• deaths, to identify bereaved children, and to other NHS digital data to identify subsequent inequalities and outcomes
• other ONS and NHS digital data such as Hospital Episode Statistics to better determine underlying cause of death, understand inequalities, risk factors and variation in child outcomes
1.2 Improving data linkage methodology
ONS plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link information relating to siblings born at different times (i.e. not twins) using NHS number of the mother. This produces very accurate linkage of siblings.
ONS can then attempt to link siblings together using only the data available in the registration data – i.e. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the results of the latter linkage method matches those achieved when linking using mother’s NHS number. This will inform the best matching methodology to use when NHS number of the mother is not available (for example in pre-2005 birth registration data).
1.3 Improving population and migration statistics
ONS plans to use births notifications data to support development and improvements of population and migration statistics. This includes a range of work such as quality assurance of Census data, contribution to ONS’s population and migration statistics transformation programme, to put administrative data first and make recommendations on the future of the decennial Census. For example, birth notifications data will be:
• used to validate Census data, with a focus on population sub-groups, such as the under 1s, returned in Census data and subsequently supporting population outputs
• used to contribute to work to estimate or quality assure characteristics of the population, such as ethnicity or age, along with other data sources
• linked to other data sources in order to carry out such improvements to existing or develop new Official Statistics, and to quality assurance other data sources
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – e.g. additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – e.g. where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
• Research and development of methodology – e.g. improving linkage methodology for siblings
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS Digital data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realized.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data based ethnicity estimates will be important when deciding whether to move to an admin data based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS Digital data experts to understand the limitations of the HES ethnicity data and there are several; for example coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘Activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about when, where and why people have accessed hospital services, for example diagnosis and procedures codes, for a range of statistical purposes in line with ONS’s function to produce statistics for the public good. All use of the HES data for health analysis will be to improve the availability and quality of health statistics.
The diagnosis and procedures information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, for the first supply of HES data to ONS the volume of this information was minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services was shared with ONS, compared with the information about when and where people have accessed services. ONS has now used and published analysis using these HES data for several purposes described in this agreement and DARS-NIC-400304-S1P1B (which allows reuse of the HES data ONS hold). Based on learning from this work ONS are now requesting further additional variables and historical times series updates where some variables were only requested for a subset of years to the current HES subset they receive.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
(i) Understanding healthy life expectancy.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
(ii) Understanding health inequalities.
Inclusion is one of the 4 pillars of the ONS strategy ‘Statistics for the Public Good’, as such exploring inequalities across outcomes is a priority for the ONS. Making use of linked morbidity, mortality, census and other data will allow ONS to produce statistics on health inequalities and provide these at a granular level. In particular, linking to these health data will help ONS to better understand if inequalities in outcomes persist when health status or pre-existing conditions are taken into account. For example, ONS have already used HES data to understand comorbidities of the population and to take this into account when modelling the risk of COVID-19 deaths by ethnicity (under DARS-NIC-400304-S1P1B). This allowed ONS to provide evidence that inequalities in outcomes still exist despite controlling for certain, but not all, health conditions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital, or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly.
It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible to develop new measures of avoidable mortality in the elderly that could have been avoided.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality.
The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments, and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, newborn and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS Digital and Public Health England (PHE) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability and geography. In some cases, NHS Digital / PHE will not hold data that would enable this, but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken by central government, health services and others.
ONS previously held HES data covering up until March 2019 and was to receive annual updates. This is not timely enough to enable all of the aims of the project. The gap in HES data between April 2019 to February 2020 (from before the UK epidemic) means ONS did not have an up to date picture of underlying health conditions. Getting retrospective monthly HES data for this period will fill this gap sooner than waiting for the final annual 2019/20 extract which will be supplied by NHSD in October 2020.
ONS also needs hospital data from during the UK epidemic to have visibility of those who are hospitalised from COVID-19 but then recover. An ongoing monthly supply of HES data will provide ONS with this information much sooner than an annual supply would provide.
A separate agreement (DARS-NIC-400304-S1P1B) has now been set up to cover this area of work related to rapid response COVID-19 analysis and additional data beyond that covered in this agreement such as primary care data and any additional statistical research projects will be updated through that agreement. The agreement, DARS-NIC-400304-S1P1B, includes permission to reuse some of the data acquired through this agreement and to link this data to other sources as specified in that agreement.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new Official Statistics.
2.7. Productivity
To f
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is usually released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released over the year in a series of themed packages. Child and infant mortality statistics and unexplained infant deaths are published annually. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
ONS are looking to improve and develop new statistics using newly linked data to explore inequalities, risk factors and variation in child outcomes. Outputs in the form of presentations, analytical articles and methodology reports will be created alongside data tables as appropriate. ONS publishes all its official statistics on its website.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Improving population and migration statistics: This will result in internal, and potentially external, ONS reports and presentations on how births notification data could be used to improve and develop official statistics, and potentially used directly in the development of new official statistics. ONS publishes all its official statistics on its website.
Dataset 2, 3 and 4: Hospital Episode Statistics, Improving Access to Psychological Therapies and Emergency Care Dataset data
The initial uses to which ONS will put HES,IAPT and ECDS data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Initial work has been carried out and new statistics published using HES data as part of the response to the coronavirus pandemic which has assured ONS of the quality and validity of using these data as initially intended such that additional data is being requested as part of this agreement to address limitations in the initial supply of HES data. Research outputs have been published on the ONS website, for example: https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/updatingethniccontrastsindeathsinvolvingthecoronaviruscovid19englandandwales/deathsoccurring2marchto28july2020
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES, IAPT or ECDS data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users, and will seek to provide frequent updates on these projects during that first stage.
DARS-NIC-175120-W5G2X-v8.4 1 July 2022 to 30 September 2022
- Title
- D5 - Office for National Statistics requirements for NHS-Digital data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 9
- Files released
- 0
Datasets: Birth Notification Data; Emergency Care Data Set (ECDS); HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES-ID to MPS-ID HES Outpatients; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5
What changed from DARS-NIC-175120-W5G2X-v7.4
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2022-07-01 | |
| End date | 2022-09-30 |
Unchanged: Objective for processing, Processing activities, Expected output, Expected measurable benefits.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS Digital, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://www.statisticsauthority.gov.uk/publication/delivering-better-statistics-for-better-decisions-data-access-legislation-march-2016/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters, and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this data sharing agreement. This process involved working closely with NHS Digital’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest, and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS Digital will also publish this data sharing agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS Digital approval. It would also require an appropriate alternative legal gateway, because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS Digital and enter into an amended Data Sharing Agreement before proceeding with that new purpose .
Dataset 1: Birth Notifications data
NHS Digital has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
There are a wide range of statistical uses to which the Office for National Statistics (ONS) intends to put Birth Notifications data. All use of Birth Notifications data by ONS will be to improve the availability and quality of statistics as part of ONS’s function to produce statistics for the public good.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required.
1.1 Birth and Child Mortality Statistics
The primary statistical purpose for which this information will be used is analysis of births, maternities, infant mortality and child health outcomes. Analyses are made publicly available as aggregate National Statistics.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics. However, there are some limitations with the GRO data, including a time lag, a lack of key information such as length of gestation and ethnicity of the baby, as well as some missing values in the fields that are available. To mitigate these limitations, the NHS Digital birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. The identifying information required from NHS Digital will enable and help quality assure this linkage, which in turn will enable ONS to produce more comprehensive and accurate statistics on births and child health outcomes.
As well as linking birth notifications data to birth registrations and deaths data to produce National Statistics these data will also be linked to other sources in order improve and development new statistics. For example, birth notifications data will be linked to:
• birth registration, deaths and census data to identify more detailed characteristics of the household and mother, such as ethnicity, and so better understand inequalities, risk factors and variation in child health outcomes
• deaths, to identify bereaved children, and to other NHS digital data to identify subsequent inequalities and outcomes
• other ONS and NHS digital data such as Hospital Episode Statistics to better determine underlying cause of death, understand inequalities, risk factors and variation in child outcomes
1.2 Improving data linkage methodology
ONS plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link information relating to siblings born at different times (i.e. not twins) using NHS number of the mother. This produces very accurate linkage of siblings.
ONS can then attempt to link siblings together using only the data available in the registration data – i.e. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the results of the latter linkage method matches those achieved when linking using mother’s NHS number. This will inform the best matching methodology to use when NHS number of the mother is not available (for example in pre-2005 birth registration data).
1.3 Improving population and migration statistics
ONS plans to use births notifications data to support development and improvements of population and migration statistics. This includes a range of work such as quality assurance of Census data, contribution to ONS’s population and migration statistics transformation programme, to put administrative data first and make recommendations on the future of the decennial Census. For example, birth notifications data will be:
• used to validate Census data, with a focus on population sub-groups, such as the under 1s, returned in Census data and subsequently supporting population outputs
• used to contribute to work to estimate or quality assure characteristics of the population, such as ethnicity or age, along with other data sources
• linked to other data sources in order to carry out such improvements to existing or develop new Official Statistics, and to quality assurance other data sources
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – e.g. additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – e.g. where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
• Research and development of methodology – e.g. improving linkage methodology for siblings
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS Digital data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realized.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data based ethnicity estimates will be important when deciding whether to move to an admin data based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS Digital data experts to understand the limitations of the HES ethnicity data and there are several; for example coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘Activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about when, where and why people have accessed hospital services, for example diagnosis and procedures codes, for a range of statistical purposes in line with ONS’s function to produce statistics for the public good. All use of the HES data for health analysis will be to improve the availability and quality of health statistics.
The diagnosis and procedures information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, for the first supply of HES data to ONS the volume of this information was minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services was shared with ONS, compared with the information about when and where people have accessed services. ONS has now used and published analysis using these HES data for several purposes described in this agreement and DARS-NIC-400304-S1P1B (which allows reuse of the HES data ONS hold). Based on learning from this work ONS are now requesting further additional variables and historical times series updates where some variables were only requested for a subset of years to the current HES subset they receive.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
(i) Understanding healthy life expectancy.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
(ii) Understanding health inequalities.
Inclusion is one of the 4 pillars of the ONS strategy ‘Statistics for the Public Good’, as such exploring inequalities across outcomes is a priority for the ONS. Making use of linked morbidity, mortality, census and other data will allow ONS to produce statistics on health inequalities and provide these at a granular level. In particular, linking to these health data will help ONS to better understand if inequalities in outcomes persist when health status or pre-existing conditions are taken into account. For example, ONS have already used HES data to understand comorbidities of the population and to take this into account when modelling the risk of COVID-19 deaths by ethnicity (under DARS-NIC-400304-S1P1B). This allowed ONS to provide evidence that inequalities in outcomes still exist despite controlling for certain, but not all, health conditions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital, or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly.
It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible to develop new measures of avoidable mortality in the elderly that could have been avoided.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality.
The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments, and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, newborn and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS Digital and Public Health England (PHE) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability and geography. In some cases, NHS Digital / PHE will not hold data that would enable this, but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken by central government, health services and others.
ONS previously held HES data covering up until March 2019 and was to receive annual updates. This is not timely enough to enable all of the aims of the project. The gap in HES data between April 2019 to February 2020 (from before the UK epidemic) means ONS did not have an up to date picture of underlying health conditions. Getting retrospective monthly HES data for this period will fill this gap sooner than waiting for the final annual 2019/20 extract which will be supplied by NHSD in October 2020.
ONS also needs hospital data from during the UK epidemic to have visibility of those who are hospitalised from COVID-19 but then recover. An ongoing monthly supply of HES data will provide ONS with this information much sooner than an annual supply would provide.
A separate agreement (DARS-NIC-400304-S1P1B) has now been set up to cover this area of work related to rapid response COVID-19 analysis and additional data beyond that covered in this agreement such as primary care data and any additional statistical research projects will be updated through that agreement. The agreement, DARS-NIC-400304-S1P1B, includes permission to reuse some of the data acquired through this agreement and to link this data to other sources as specified in that agreement.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new Official Statistics.
2.7. Productivity
To f
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is usually released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released over the year in a series of themed packages. Child and infant mortality statistics and unexplained infant deaths are published annually. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
ONS are looking to improve and develop new statistics using newly linked data to explore inequalities, risk factors and variation in child outcomes. Outputs in the form of presentations, analytical articles and methodology reports will be created alongside data tables as appropriate. ONS publishes all its official statistics on its website.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Improving population and migration statistics: This will result in internal, and potentially external, ONS reports and presentations on how births notification data could be used to improve and develop official statistics, and potentially used directly in the development of new official statistics. ONS publishes all its official statistics on its website.
Dataset 2, 3 and 4: Hospital Episode Statistics, Improving Access to Psychological Therapies and Emergency Care Dataset data
The initial uses to which ONS will put HES,IAPT and ECDS data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Initial work has been carried out and new statistics published using HES data as part of the response to the coronavirus pandemic which has assured ONS of the quality and validity of using these data as initially intended such that additional data is being requested as part of this agreement to address limitations in the initial supply of HES data. Research outputs have been published on the ONS website, for example: https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/updatingethniccontrastsindeathsinvolvingthecoronaviruscovid19englandandwales/deathsoccurring2marchto28july2020
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES, IAPT or ECDS data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users, and will seek to provide frequent updates on these projects during that first stage.
DARS-NIC-175120-W5G2X-v7.4 20 May 2021 to 31 May 2022
- Title
- D5 - Office for National Statistics requirements for NHS-Digital data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 9
- Files released
- 107
Datasets: Birth Notification Data; Emergency Care Data Set (ECDS); HES-ID to MPS-ID HES Accident and Emergency; HES-ID to MPS-ID HES Admitted Patient Care; HES-ID to MPS-ID HES Outpatients; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5
What changed from DARS-NIC-175120-W5G2X-v6.4
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2021-05-20 | |
| End date | 2022-05-31 |
Datasets: + Emergency Care Data Set (ECDS); + HES-ID to MPS-ID HES Accident and Emergency; + HES-ID to MPS-ID HES Admitted Patient Care; + HES-ID to MPS-ID HES Outpatients
Objective for processing
[29 paragraphs unchanged]
The data shared with ONS under this agreement will not be onwardly
[24 words unchanged]
Statistics Analysis Guide. Any exceptions to this would require additional NHS Digital
approval .
approval.
It would also require an appropriate alternative legal gateway, because section 45c
[15 words unchanged]
shared with ONS (not for example, other Government departments or academic researchers).
[4 paragraphs unchanged]
The birth notifications data contribute to ONS statistical analyses of births, maternities, and infant mortality outcomes. Analyses are made publicly available as aggregate National Statistics. These statistics help a range of public and other bodies make better decisions (see section 5d). They also feed into the Department of Health's NHS Outcomes Framework for monitoring low birthweight of term babies.
There are a wide range of statistical uses to which the Office for National Statistics (ONS) intends to put Birth Notifications data. All use of Birth Notifications data by ONS will be to improve the availability and quality of statistics as part of ONS’s function to produce statistics for the public good.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics, and ONS become controllers of that data under Section 42 of the 2007 Statistics and Registration Services Act. However, there are some limitations with the GRO data, including a lack of medical information such as length of gestation, as well as some missing and implausible values in the fields that are available.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required.
To mitigate these limitations, the NHS Digital birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. Several identifying variables such as NHS number are received to enable this linkage.
1.1 Birth and Child Mortality Statistics
The primary statistical purpose for which this information will be used is analysis of births, maternities, infant mortality and child health outcomes. Analyses are made publicly available as aggregate National Statistics.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics. However, there are some limitations with the GRO data, including a time lag, a lack of key information such as length of gestation and ethnicity of the baby, as well as some missing values in the fields that are available. To mitigate these limitations, the NHS Digital birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. The identifying information required from NHS Digital will enable and help quality assure this linkage, which in turn will enable ONS to produce more comprehensive and accurate statistics on births and child health outcomes.
As well as linking birth notifications data to birth registrations and deaths data to produce National Statistics these data will also be linked to other sources in order improve and development new statistics. For example, birth notifications data will be linked to:
• birth registration, deaths and census data to identify more detailed characteristics of the household and mother, such as ethnicity, and so better understand inequalities, risk factors and variation in child health outcomes
• deaths, to identify bereaved children, and to other NHS digital data to identify subsequent inequalities and outcomes
• other ONS and NHS digital data such as Hospital Episode Statistics to better determine underlying cause of death, understand inequalities, risk factors and variation in child outcomes
1.2 Improving data linkage methodology
ONS plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link information relating to siblings born at different times (i.e. not twins) using NHS number of the mother. This produces very accurate linkage of siblings.
ONS can then attempt to link siblings together using only the data available in the registration data – i.e. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the results of the latter linkage method matches those achieved when linking using mother’s NHS number. This will inform the best matching methodology to use when NHS number of the mother is not available (for example in pre-2005 birth registration data).
1.3 Improving population and migration statistics
ONS plans to use births notifications data to support development and improvements of population and migration statistics. This includes a range of work such as quality assurance of Census data, contribution to ONS’s population and migration statistics transformation programme, to put administrative data first and make recommendations on the future of the decennial Census. For example, birth notifications data will be:
• used to validate Census data, with a focus on population sub-groups, such as the under 1s, returned in Census data and subsequently supporting population outputs
• used to contribute to work to estimate or quality assure characteristics of the population, such as ethnicity or age, along with other data sources
• linked to other data sources in order to carry out such improvements to existing or develop new Official Statistics, and to quality assurance other data sources
[1 paragraph unchanged]
• Improving official statistics –
e.g.
additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics –
e.g.
where information is on both sources, the birth notifications data can be
[14 words unchanged]
(overwrite) the birth registrations data where that value is missing or implausible
ONS also plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link siblings born at different times (i.e. not twins) using the NHS number of the mother which is only available on the notification data. This provides a ‘gold standard’ linkage method.
• Research and development of methodology – e.g. improving linkage methodology for siblings
ONS can then then attempt to link siblings together using only the data available in the registration data – e.g. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the latter linkage method matches the gold standard. This will inform the best matching methodology to use when seeking to link siblings if NHS number of mother is not available. This is needed to link pre-2005 birth registration data, a time when the birth notification data is not available to ONS. This purpose would fall under the Research and development of methodology category in the uses framework above.
[23 paragraphs unchanged]
ONS’s health analysts will use information about
when, where and
why people have accessed hospital services, for example
diagnosis,
diagnosis and procedures codes,
for a range of statistical
purposes.
purposes in line with ONS’s function to produce statistics for the public good. All use of the HES data for health analysis will be to improve the availability and quality of health statistics.
This
The diagnosis and procedures
information is clearly more sensitive, and the intended statistical uses will require
[5 words unchanged]
statistics of sufficient quality can be produced using HES data. As such,
for the first supply of HES data to ONS
the volume of this information
is being
was
minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services
will be
was
shared with ONS, compared with the information about when and where people have accessed services.
ONS has now used and published analysis using these HES data for several purposes described in this agreement and DARS-NIC-400304-S1P1B (which allows reuse of the HES data ONS hold). Based on learning from this work ONS are now requesting further additional variables and historical times series updates where some variables were only requested for a subset of years to the current HES subset they receive.
[6 paragraphs unchanged]
(i) Understanding healthy life expectancy.
[4 paragraphs unchanged]
(ii) Understanding health inequalities.
Inclusion is one of the 4 pillars of the ONS strategy ‘Statistics for the Public Good’, as such exploring inequalities across outcomes is a priority for the ONS. Making use of linked morbidity, mortality, census and other data will allow ONS to produce statistics on health inequalities and provide these at a granular level. In particular, linking to these health data will help ONS to better understand if inequalities in outcomes persist when health status or pre-existing conditions are taken into account. For example, ONS have already used HES data to understand comorbidities of the population and to take this into account when modelling the risk of COVID-19 deaths by ethnicity (under DARS-NIC-400304-S1P1B). This allowed ONS to provide evidence that inequalities in outcomes still exist despite controlling for certain, but not all, health conditions.
[2 paragraphs unchanged]
(i) Understanding multi-morbidity and vulnerability in the elderly. It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible to develop new measures of avoidable mortality in the elderly.
(i) Understanding multi-morbidity and vulnerability in the elderly.
It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible to develop new measures of avoidable mortality in the elderly that could have been avoided.
[1 paragraph unchanged]
(ii) Understanding infant mortality. The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
(ii) Understanding infant mortality.
The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
[22 paragraphs unchanged]
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people
[22 words unchanged]
COVID-19 linkage project. Data will be linked to data on Deaths, demographics
(2011 Census)
(Census)
and primary care data to establish and assess commodities and risk factors associated with COVID-19.
[3 paragraphs unchanged]
Dataset 3: Improving Access to Psychological Therapies (IAPT) Dataset
A separate agreement (DARS-NIC-400304-S1P1B) has now been set up to cover this area of work related to rapid response COVID-19 analysis and additional data beyond that covered in this agreement such as primary care data and any additional statistical research projects will be updated through that agreement. The agreement, DARS-NIC-400304-S1P1B, includes permission to reuse some of the data acquired through this agreement and to link this data to other sources as specified in that agreement.
3.1. To enable research being conducted by ONS’ Administrative Data Census and Migration Statistics improvement projects using ‘activity’ and characteristics data from IAPT.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new Official Statistics.
This first use is essentially the same as described for the uses of HES data within these projects: The IAPT data provides evidence of presence at a particular address, and it also includes information on characteristics including ethnicity. See section 2.1 above (within the HES section) for the full rationale for why this information is needed.
2.7. Productivity
3.2. To conduct a range of Statistical Research and Health Analyses using IAPT data
To f
a. Statistical Research to inform Primary Mental Health Service Policy Making
This project will focus on common mental health disorders (CMDs) such as anxiety and depression. Using a phased approach, ONS will look first at the mortality risk of people with CMDs, co-morbidities between mental and physical health problems, and investigate inequalities around mental health. In the second phase, ONS will investigate income and employment transitions for patients who have been through mental health treatment.
The first phase will address existing evidence gaps on co-morbidities between mental and physical health, improve understanding on the demographics of people with CMDs, and investigate whether some or all people with CMDs are more at risk of death than the general population.
The IAPT data for 2012 to 2017 will be linked to the 2011 Census to provide detailed demographic background, and to death registrations from 2012 to 2018. The mortality analysis will focus on specific causes of death which may be connected to mental health (suicide, alcohol and drug abuse) as well as overall risk. In addition, the causes of death will be compared to the distribution of causes in the general population to identify any common co-morbidity with life-threatening illnesses. This goes some way to provide insight into important issues raised by the NHS England Five Year Forward View on mental health:
“An important barrier to good care is the lack of appropriate data sharing to enable organisations to identify co-morbidities…People with poor mental health may require primary care, secondary physical care and social care, as well as mental health services, but the lack of linked datasets hinders effective provision.”
IAPT data is estimated to cover over 15% of people with CMDs in England. Because of the service’s large, national scale and focus on people with mild and moderate mental health conditions, it provides a reasonable proxy for patterns and trends in the population of people with diagnosable CMDs.
The IAPT data will be compared with the findings of the Adult Psychiatric Morbidity Survey (2007 and 2014) to assess likely issues of representativeness, such as the under-representation of specific population groups in the treatment cohort. People with severe mental health conditions are not typically treated in the IAPT programme.
The three-way linkage will provide an independent and more detailed demographic baseline than the IAPT data could do alone, and allow ONS to investigate if there have been changes in peoples’ circumstances between the Census and treatment in IAPT (e.g. becoming disabled or living alone). Having the mortality data linked as well allows ONS to see the overall trends in mortality, plus to see if there is any relationship between changes in demographics and the cause of death outcomes.
The research is not aiming to look at individual level outcomes or to evaluate the IAPT treatment, but to look for trends in the aggregate data after linkage, to provide population level analysis to inform policy.
Entry into IAPT treatment will be used as the main indicator of having a diagnosable CMD. The clinical data will not be analysed except to:
• Group the cohort into broad types of CMD
• Potentially, link successful/unsuccessful treatment outcome to risk of subsequent death.
b. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local
Processing activities
[12 paragraphs unchanged]
Dataset
2
1, 2, 3
and
3:
4: Birth Notifications,
Hospital Episode Statistics
(HES) and
(HES),
Improving Access to Psychological Therapies (IAPT)
and Emergency Care Dataset
data
[17 paragraphs unchanged]
As noted above within the
ONS
is in the process of enhancing the capabilities of its Data Access Platform to allow
data environment users set up ‘project spaces’ and apply
for
variable-by-variable control of researcher access granting. Until this is completed, any analyst who is granted
access to
data through
the
dataset will technically have
Information Asset Owner, each ‘project space’ includes only the data required to carry out their analysis and only the users who require
access to
all variables and identifiers. However, users
that data. Users
will not be permitted to access identifiers for the purposes of analysis.
[32 words unchanged]
clearance. All other staff will only be permitted to access non-identifying data.
Inadvertent re-identification is still a risk but
ONS will never seek to intentionally re-identify this data. ONS staff are
[63 words unchanged]
transit and will always be protected by procedural controls in place now
and technical controls to be implemented by 31/12/2019 to enforce the controls as described above.
[8 paragraphs unchanged]
The clearest example of the need for the information in this agreement
[32 words unchanged]
and products that cover the whole of England (and beyond), so complete
HES
BN, HES, ECDS
and IAPT coverage is required. In addition, a decision is required post-2021
[60 words unchanged]
them to the gold standard Census figures available for 2011 and 2021.
For the health analysis purposes presented in section 5a that require why
[62 words unchanged]
produced. In addition, diagnosis information is clearly more sensitive. As a result,
ONS has
ONS’s initial request for these data
determined that it
is
was
proportionate and in the public interest that the years worth of HES diagnosis information required
is minimised for now. It will still be possible to test statistical quality for
was minimised. Following analysis using
these
uses with this volume
data ONS are now assured
of
information. But ONS do expect this work to be successful
the utility of these data
and
if it is ONS will require additional years
are now requiring a backseries
of diagnosis
information be shared at a later date.
codes previously received as well as requiring additional procedure codes.
Access to data held within the Data Access Platform (DAP), which includes HES data, is granted to users on a need-to-know basis depending on their role, through a request process which provides a business justification. Access is authorised on a case-by-case basis by the ONS Information Asset Owner (IAO) responsible for HES data, with advice from Security and Information Management. Staff requesting access to HES data must be cleared to the appropriate National Vetting level, which is higher than the standard basic clearance required for all ONS staff. Only authorised ONS staff with appropriate security clearance will have access to identifiable HES data, with regular audit and monitoring in place to ensure compliance.
Analysis using diagnosis information has proved successful in understanding and controlling for hospital-based conditions and comorbidities as part of the ONS’s COVID-19 analysis (see section 5c, 2.6). This analysis provides assurance that these data can also be used successfully for the wider purposes outlined in this agreement. However, a key limitation of the analysis was the limited number of years of data available and the breadth of variables. For APC & OP, ONS has identified further that procedure codes are also required to ensure ONS have a full range of risk predictors and capture important clinical events following discharge from hospital.
In addition, for APC, ONS are also requesting new codes to support new work ONS has been commissioned to do by DHSC on productivity. The work involves taking over analysis previously carried out by University of York and the additional variables requested include only those required to replicate this already established analysis.
Access to data held within the Data Access Platform (DAP), which includes BN, HES, ECDS and IAPT data, is granted to users on a need-to-know basis depending on their role, through a request process which provides a business justification. Access is authorised on a case-by-case basis by the ONS Information Asset Owner (IAO) responsible for HES data, with advice from Security and Information Management. Staff requesting access to these data must be cleared to the appropriate National Vetting level, which is higher than the standard basic clearance required for all ONS staff. Only authorised ONS staff with appropriate security clearance will have access to identifiable HES data, with regular audit and monitoring in place to ensure compliance.
Expected output
[2 paragraphs unchanged]
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is
usually
released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released
between August and December
over the year
in a series of themed packages.
Child and infant mortality statistics and unexplained infant deaths are published annually.
Each package consists of a number of data tables; these are generally
[7 words unchanged]
provide the latest year’s figures with some also showing historical data for
comparison, sometimes back to 1837.
comparison.
ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
There are several published packages:
ONS are looking to improve and develop new statistics using newly linked data to explore inequalities, risk factors and variation in child outcomes. Outputs in the form of presentations, analytical articles and methodology reports will be created alongside data tables as appropriate. ONS publishes all its official statistics on its website.
Birth summary tables: includes the number of live births and stillbirths, fertility rates, percentage of live births outside marriage and civil partnership, mean age of mother and percentage of live births to non-UK born mothers for England and Wales as a whole. Live births (number and rate) and the number of stillbirths are also provided down to local authority level. To aid with user interpretation, ONS also publishes an interactive fertility mapping tool, which enables users to analyse trends in fertility by county district and unitary authority; this is contained within the statistical bulletin.
Parents’ country of birth: includes births by country of birth of mother and total fertility rates for UK born and non-UK born women for England and Wales as a whole. Summary figures are also available down to local authority level. ONS publishes detailed analysis on parents’ country of birth because this information is collected at birth registration and does not change over time, while their nationality or ethnicity may change.
Birth characteristics and by area of usual residence: contains statistics on stillbirths and maternities for England and Wales, birthweight data for live and stillbirths by mother's region of usual residence, and live births and stillbirths in hospitals and communal establishments by region of occurrence. These tables also provide figures on month and quarter of occurrence, place of birth, ethnicity and gestational age and multiple births for England and Wales as a whole. Also provides summary data for live births down to local authority level including figures by age of mother figures are published using boundaries in place during the year the birth occurred.
Births by parents’ characteristics: provides live birth, stillbirth and maternity statistics by age of mother and type of registration (within marriage and civil partnership, joint, sole). It also provides data on previous live-born children, National Statistics Socio-economic Classification (NS-SEC), median birth intervals, age-specific fertility rates for men and mean age of fathers. All tables are for England and Wales as a whole with no sub-national breakdown.
Childbearing for women born in different years (formerly known as Cohort fertility): presents data on fertility by year of birth of mother rather than the year of birth of child for England and Wales as a whole this package includes the average number of live-born children and the proportion of women remaining childless for women born in different years.
[1 paragraph unchanged]
Dataset 2 and dataset 3: Hospital Episode Statistics and Improving Access to Psychological Therapies data
Improving population and migration statistics: This will result in internal, and potentially external, ONS reports and presentations on how births notification data could be used to improve and develop official statistics, and potentially used directly in the development of new official statistics. ONS publishes all its official statistics on its website.
The initial uses to which ONS will put HES and IAPT data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Dataset 2, 3 and 4: Hospital Episode Statistics, Improving Access to Psychological Therapies and Emergency Care Dataset data
The initial uses to which ONS will put HES,IAPT and ECDS data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
[2 paragraphs unchanged]
Initial work has been carried out and new statistics published using HES data as part of the response to the coronavirus pandemic which has assured ONS of the quality and validity of using these data as initially intended such that additional data is being requested as part of this agreement to address limitations in the initial supply of HES data. Research outputs have been published on the ONS website, for example: https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/updatingethniccontrastsindeathsinvolvingthecoronaviruscovid19englandandwales/deathsoccurring2marchto28july2020
[4 paragraphs unchanged]
No targets can be given as to if and when experimental or National Statistics will be produced using
HES
HES, IAPT
or
IAPT
ECDS
data until the initial stage of any given project is complete. All
[9 words unchanged]
seek to provide frequent updates on these projects during that first stage.
Expected measurable benefits
[5 paragraphs unchanged]
Other users
of births, child and infant mortality and child outcome statistics
include academics, demographers and health researchers, who conduct research into trends and characteristics. Lobby groups use
birth
the
statistics for their cause, for example, campaigns against school closures or midwife
[58 words unchanged]
monitor trends. Organisations such as Eurostat and the UN use ONS birth
and child and infant mortality
statistics for international comparison purposes. The media also report on trends and statistics.
[45 paragraphs unchanged]
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS Digital, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://www.statisticsauthority.gov.uk/publication/delivering-better-statistics-for-better-decisions-data-access-legislation-march-2016/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters, and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this data sharing agreement. This process involved working closely with NHS Digital’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest, and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS Digital will also publish this data sharing agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS Digital approval. It would also require an appropriate alternative legal gateway, because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS Digital and enter into an amended Data Sharing Agreement before proceeding with that new purpose .
Dataset 1: Birth Notifications data
NHS Digital has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
There are a wide range of statistical uses to which the Office for National Statistics (ONS) intends to put Birth Notifications data. All use of Birth Notifications data by ONS will be to improve the availability and quality of statistics as part of ONS’s function to produce statistics for the public good.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required.
1.1 Birth and Child Mortality Statistics
The primary statistical purpose for which this information will be used is analysis of births, maternities, infant mortality and child health outcomes. Analyses are made publicly available as aggregate National Statistics.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics. However, there are some limitations with the GRO data, including a time lag, a lack of key information such as length of gestation and ethnicity of the baby, as well as some missing values in the fields that are available. To mitigate these limitations, the NHS Digital birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. The identifying information required from NHS Digital will enable and help quality assure this linkage, which in turn will enable ONS to produce more comprehensive and accurate statistics on births and child health outcomes.
As well as linking birth notifications data to birth registrations and deaths data to produce National Statistics these data will also be linked to other sources in order improve and development new statistics. For example, birth notifications data will be linked to:
• birth registration, deaths and census data to identify more detailed characteristics of the household and mother, such as ethnicity, and so better understand inequalities, risk factors and variation in child health outcomes
• deaths, to identify bereaved children, and to other NHS digital data to identify subsequent inequalities and outcomes
• other ONS and NHS digital data such as Hospital Episode Statistics to better determine underlying cause of death, understand inequalities, risk factors and variation in child outcomes
1.2 Improving data linkage methodology
ONS plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link information relating to siblings born at different times (i.e. not twins) using NHS number of the mother. This produces very accurate linkage of siblings.
ONS can then attempt to link siblings together using only the data available in the registration data – i.e. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the results of the latter linkage method matches those achieved when linking using mother’s NHS number. This will inform the best matching methodology to use when NHS number of the mother is not available (for example in pre-2005 birth registration data).
1.3 Improving population and migration statistics
ONS plans to use births notifications data to support development and improvements of population and migration statistics. This includes a range of work such as quality assurance of Census data, contribution to ONS’s population and migration statistics transformation programme, to put administrative data first and make recommendations on the future of the decennial Census. For example, birth notifications data will be:
• used to validate Census data, with a focus on population sub-groups, such as the under 1s, returned in Census data and subsequently supporting population outputs
• used to contribute to work to estimate or quality assure characteristics of the population, such as ethnicity or age, along with other data sources
• linked to other data sources in order to carry out such improvements to existing or develop new Official Statistics, and to quality assurance other data sources
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – e.g. additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – e.g. where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
• Research and development of methodology – e.g. improving linkage methodology for siblings
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS Digital data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realized.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data based ethnicity estimates will be important when deciding whether to move to an admin data based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS Digital data experts to understand the limitations of the HES ethnicity data and there are several; for example coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘Activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about when, where and why people have accessed hospital services, for example diagnosis and procedures codes, for a range of statistical purposes in line with ONS’s function to produce statistics for the public good. All use of the HES data for health analysis will be to improve the availability and quality of health statistics.
The diagnosis and procedures information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, for the first supply of HES data to ONS the volume of this information was minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services was shared with ONS, compared with the information about when and where people have accessed services. ONS has now used and published analysis using these HES data for several purposes described in this agreement and DARS-NIC-400304-S1P1B (which allows reuse of the HES data ONS hold). Based on learning from this work ONS are now requesting further additional variables and historical times series updates where some variables were only requested for a subset of years to the current HES subset they receive.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
(i) Understanding healthy life expectancy.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
(ii) Understanding health inequalities.
Inclusion is one of the 4 pillars of the ONS strategy ‘Statistics for the Public Good’, as such exploring inequalities across outcomes is a priority for the ONS. Making use of linked morbidity, mortality, census and other data will allow ONS to produce statistics on health inequalities and provide these at a granular level. In particular, linking to these health data will help ONS to better understand if inequalities in outcomes persist when health status or pre-existing conditions are taken into account. For example, ONS have already used HES data to understand comorbidities of the population and to take this into account when modelling the risk of COVID-19 deaths by ethnicity (under DARS-NIC-400304-S1P1B). This allowed ONS to provide evidence that inequalities in outcomes still exist despite controlling for certain, but not all, health conditions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital, or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly.
It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible to develop new measures of avoidable mortality in the elderly that could have been avoided.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality.
The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments, and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, newborn and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS Digital and Public Health England (PHE) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability and geography. In some cases, NHS Digital / PHE will not hold data that would enable this, but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken by central government, health services and others.
ONS previously held HES data covering up until March 2019 and was to receive annual updates. This is not timely enough to enable all of the aims of the project. The gap in HES data between April 2019 to February 2020 (from before the UK epidemic) means ONS did not have an up to date picture of underlying health conditions. Getting retrospective monthly HES data for this period will fill this gap sooner than waiting for the final annual 2019/20 extract which will be supplied by NHSD in October 2020.
ONS also needs hospital data from during the UK epidemic to have visibility of those who are hospitalised from COVID-19 but then recover. An ongoing monthly supply of HES data will provide ONS with this information much sooner than an annual supply would provide.
A separate agreement (DARS-NIC-400304-S1P1B) has now been set up to cover this area of work related to rapid response COVID-19 analysis and additional data beyond that covered in this agreement such as primary care data and any additional statistical research projects will be updated through that agreement. The agreement, DARS-NIC-400304-S1P1B, includes permission to reuse some of the data acquired through this agreement and to link this data to other sources as specified in that agreement.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new Official Statistics.
2.7. Productivity
To f
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is usually released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released over the year in a series of themed packages. Child and infant mortality statistics and unexplained infant deaths are published annually. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
ONS are looking to improve and develop new statistics using newly linked data to explore inequalities, risk factors and variation in child outcomes. Outputs in the form of presentations, analytical articles and methodology reports will be created alongside data tables as appropriate. ONS publishes all its official statistics on its website.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Improving population and migration statistics: This will result in internal, and potentially external, ONS reports and presentations on how births notification data could be used to improve and develop official statistics, and potentially used directly in the development of new official statistics. ONS publishes all its official statistics on its website.
Dataset 2, 3 and 4: Hospital Episode Statistics, Improving Access to Psychological Therapies and Emergency Care Dataset data
The initial uses to which ONS will put HES,IAPT and ECDS data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Initial work has been carried out and new statistics published using HES data as part of the response to the coronavirus pandemic which has assured ONS of the quality and validity of using these data as initially intended such that additional data is being requested as part of this agreement to address limitations in the initial supply of HES data. Research outputs have been published on the ONS website, for example: https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/updatingethniccontrastsindeathsinvolvingthecoronaviruscovid19englandandwales/deathsoccurring2marchto28july2020
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES, IAPT or ECDS data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users, and will seek to provide frequent updates on these projects during that first stage.
DARS-NIC-175120-W5G2X-v6.4 4 December 2020 to 24 June 2022
- Title
- D5 - Office for National Statistics requirements for NHS-Digital data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 5
- Files released
- 13
Datasets: Birth Notification Data; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5
What changed from DARS-NIC-175120-W5G2X-v5.2
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2020-12-04 |
Processing activities
[42 paragraphs unchanged]
Access to data held within the Data Access Platform (DAP), which includes
[88 words unchanged]
identifiable HES data, with regular audit and monitoring in place to ensure
compliance
compliance.
Changed only in punctuation, spacing or capitalisation: Objective for processing.
Unchanged: Expected output, Expected measurable benefits.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS Digital, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://www.statisticsauthority.gov.uk/publication/delivering-better-statistics-for-better-decisions-data-access-legislation-march-2016/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters, and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this data sharing agreement. This process involved working closely with NHS Digital’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest, and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS Digital will also publish this data sharing agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS Digital approval . It would also require an appropriate alternative legal gateway, because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS Digital and enter into an amended Data Sharing Agreement before proceeding with that new purpose .
Dataset 1: Birth Notifications data
NHS Digital has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
The birth notifications data contribute to ONS statistical analyses of births, maternities, and infant mortality outcomes. Analyses are made publicly available as aggregate National Statistics. These statistics help a range of public and other bodies make better decisions (see section 5d). They also feed into the Department of Health's NHS Outcomes Framework for monitoring low birthweight of term babies.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics, and ONS become controllers of that data under Section 42 of the 2007 Statistics and Registration Services Act. However, there are some limitations with the GRO data, including a lack of medical information such as length of gestation, as well as some missing and implausible values in the fields that are available.
To mitigate these limitations, the NHS Digital birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. Several identifying variables such as NHS number are received to enable this linkage.
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
ONS also plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link siblings born at different times (i.e. not twins) using the NHS number of the mother which is only available on the notification data. This provides a ‘gold standard’ linkage method.
ONS can then then attempt to link siblings together using only the data available in the registration data – e.g. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the latter linkage method matches the gold standard. This will inform the best matching methodology to use when seeking to link siblings if NHS number of mother is not available. This is needed to link pre-2005 birth registration data, a time when the birth notification data is not available to ONS. This purpose would fall under the Research and development of methodology category in the uses framework above.
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS Digital data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realized.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data based ethnicity estimates will be important when deciding whether to move to an admin data based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS Digital data experts to understand the limitations of the HES ethnicity data and there are several; for example coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘Activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about why people have accessed hospital services, for example diagnosis, for a range of statistical purposes.
This information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, the volume of this information is being minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services will be shared with ONS, compared with the information about when and where people have accessed services.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital, or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly. It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible to develop new measures of avoidable mortality in the elderly.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality. The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments, and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, newborn and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS Digital and Public Health England (PHE) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability and geography. In some cases, NHS Digital / PHE will not hold data that would enable this, but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (2011 Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken by central government, health services and others.
ONS previously held HES data covering up until March 2019 and was to receive annual updates. This is not timely enough to enable all of the aims of the project. The gap in HES data between April 2019 to February 2020 (from before the UK epidemic) means ONS did not have an up to date picture of underlying health conditions. Getting retrospective monthly HES data for this period will fill this gap sooner than waiting for the final annual 2019/20 extract which will be supplied by NHSD in October 2020.
ONS also needs hospital data from during the UK epidemic to have visibility of those who are hospitalised from COVID-19 but then recover. An ongoing monthly supply of HES data will provide ONS with this information much sooner than an annual supply would provide.
Dataset 3: Improving Access to Psychological Therapies (IAPT) Dataset
3.1. To enable research being conducted by ONS’ Administrative Data Census and Migration Statistics improvement projects using ‘activity’ and characteristics data from IAPT.
This first use is essentially the same as described for the uses of HES data within these projects: The IAPT data provides evidence of presence at a particular address, and it also includes information on characteristics including ethnicity. See section 2.1 above (within the HES section) for the full rationale for why this information is needed.
3.2. To conduct a range of Statistical Research and Health Analyses using IAPT data
a. Statistical Research to inform Primary Mental Health Service Policy Making
This project will focus on common mental health disorders (CMDs) such as anxiety and depression. Using a phased approach, ONS will look first at the mortality risk of people with CMDs, co-morbidities between mental and physical health problems, and investigate inequalities around mental health. In the second phase, ONS will investigate income and employment transitions for patients who have been through mental health treatment.
The first phase will address existing evidence gaps on co-morbidities between mental and physical health, improve understanding on the demographics of people with CMDs, and investigate whether some or all people with CMDs are more at risk of death than the general population.
The IAPT data for 2012 to 2017 will be linked to the 2011 Census to provide detailed demographic background, and to death registrations from 2012 to 2018. The mortality analysis will focus on specific causes of death which may be connected to mental health (suicide, alcohol and drug abuse) as well as overall risk. In addition, the causes of death will be compared to the distribution of causes in the general population to identify any common co-morbidity with life-threatening illnesses. This goes some way to provide insight into important issues raised by the NHS England Five Year Forward View on mental health:
“An important barrier to good care is the lack of appropriate data sharing to enable organisations to identify co-morbidities…People with poor mental health may require primary care, secondary physical care and social care, as well as mental health services, but the lack of linked datasets hinders effective provision.”
IAPT data is estimated to cover over 15% of people with CMDs in England. Because of the service’s large, national scale and focus on people with mild and moderate mental health conditions, it provides a reasonable proxy for patterns and trends in the population of people with diagnosable CMDs.
The IAPT data will be compared with the findings of the Adult Psychiatric Morbidity Survey (2007 and 2014) to assess likely issues of representativeness, such as the under-representation of specific population groups in the treatment cohort. People with severe mental health conditions are not typically treated in the IAPT programme.
The three-way linkage will provide an independent and more detailed demographic baseline than the IAPT data could do alone, and allow ONS to investigate if there have been changes in peoples’ circumstances between the Census and treatment in IAPT (e.g. becoming disabled or living alone). Having the mortality data linked as well allows ONS to see the overall trends in mortality, plus to see if there is any relationship between changes in demographics and the cause of death outcomes.
The research is not aiming to look at individual level outcomes or to evaluate the IAPT treatment, but to look for trends in the aggregate data after linkage, to provide population level analysis to inform policy.
Entry into IAPT treatment will be used as the main indicator of having a diagnosable CMD. The clinical data will not be analysed except to:
• Group the cohort into broad types of CMD
• Potentially, link successful/unsuccessful treatment outcome to risk of subsequent death.
b. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released between August and December in a series of themed packages. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison, sometimes back to 1837. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
There are several published packages:
Birth summary tables: includes the number of live births and stillbirths, fertility rates, percentage of live births outside marriage and civil partnership, mean age of mother and percentage of live births to non-UK born mothers for England and Wales as a whole. Live births (number and rate) and the number of stillbirths are also provided down to local authority level. To aid with user interpretation, ONS also publishes an interactive fertility mapping tool, which enables users to analyse trends in fertility by county district and unitary authority; this is contained within the statistical bulletin.
Parents’ country of birth: includes births by country of birth of mother and total fertility rates for UK born and non-UK born women for England and Wales as a whole. Summary figures are also available down to local authority level. ONS publishes detailed analysis on parents’ country of birth because this information is collected at birth registration and does not change over time, while their nationality or ethnicity may change.
Birth characteristics and by area of usual residence: contains statistics on stillbirths and maternities for England and Wales, birthweight data for live and stillbirths by mother's region of usual residence, and live births and stillbirths in hospitals and communal establishments by region of occurrence. These tables also provide figures on month and quarter of occurrence, place of birth, ethnicity and gestational age and multiple births for England and Wales as a whole. Also provides summary data for live births down to local authority level including figures by age of mother figures are published using boundaries in place during the year the birth occurred.
Births by parents’ characteristics: provides live birth, stillbirth and maternity statistics by age of mother and type of registration (within marriage and civil partnership, joint, sole). It also provides data on previous live-born children, National Statistics Socio-economic Classification (NS-SEC), median birth intervals, age-specific fertility rates for men and mean age of fathers. All tables are for England and Wales as a whole with no sub-national breakdown.
Childbearing for women born in different years (formerly known as Cohort fertility): presents data on fertility by year of birth of mother rather than the year of birth of child for England and Wales as a whole this package includes the average number of live-born children and the proportion of women remaining childless for women born in different years.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Dataset 2 and dataset 3: Hospital Episode Statistics and Improving Access to Psychological Therapies data
The initial uses to which ONS will put HES and IAPT data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES or IAPT data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users, and will seek to provide frequent updates on these projects during that first stage.
DARS-NIC-175120-W5G2X-v5.2 25 June 2020 to 24 June 2022
- Title
- D5 - Office for National Statistics requirements for NHS-Digital data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 5
- Files released
- 12
Datasets: Birth Notification Data; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5
What changed from DARS-NIC-175120-W5G2X-v4.2
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2020-06-25 | |
| End date | 2022-06-24 |
Unchanged: Objective for processing, Processing activities, Expected output, Expected measurable benefits.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS Digital, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://www.statisticsauthority.gov.uk/publication/delivering-better-statistics-for-better-decisions-data-access-legislation-march-2016/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters, and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this data sharing agreement. This process involved working closely with NHS Digital’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest, and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS Digital will also publish this data sharing agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS Digital approval . It would also require an appropriate alternative legal gateway, because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS Digital and enter into an amended Data Sharing Agreement before proceeding with that new purpose .
Dataset 1: Birth Notifications data
NHS Digital has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
The birth notifications data contribute to ONS statistical analyses of births, maternities, and infant mortality outcomes. Analyses are made publicly available as aggregate National Statistics. These statistics help a range of public and other bodies make better decisions (see section 5d). They also feed into the Department of Health's NHS Outcomes Framework for monitoring low birthweight of term babies.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics, and ONS become controllers of that data under Section 42 of the 2007 Statistics and Registration Services Act. However, there are some limitations with the GRO data, including a lack of medical information such as length of gestation, as well as some missing and implausible values in the fields that are available.
To mitigate these limitations, the NHS Digital birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. Several identifying variables such as NHS number are received to enable this linkage.
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
ONS also plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link siblings born at different times (i.e. not twins) using the NHS number of the mother which is only available on the notification data. This provides a ‘gold standard’ linkage method.
ONS can then then attempt to link siblings together using only the data available in the registration data – e.g. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the latter linkage method matches the gold standard. This will inform the best matching methodology to use when seeking to link siblings if NHS number of mother is not available. This is needed to link pre-2005 birth registration data, a time when the birth notification data is not available to ONS. This purpose would fall under the Research and development of methodology category in the uses framework above.
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS Digital data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realized.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data based ethnicity estimates will be important when deciding whether to move to an admin data based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS Digital data experts to understand the limitations of the HES ethnicity data and there are several; for example coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘Activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about why people have accessed hospital services, for example diagnosis, for a range of statistical purposes.
This information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, the volume of this information is being minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services will be shared with ONS, compared with the information about when and where people have accessed services.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital, or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly. It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible to develop new measures of avoidable mortality in the elderly.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality. The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments, and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, newborn and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS Digital and Public Health England (PHE) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability and geography. In some cases, NHS Digital / PHE will not hold data that would enable this, but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (2011 Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken by central government, health services and others.
ONS previously held HES data covering up until March 2019 and was to receive annual updates. This is not timely enough to enable all of the aims of the project. The gap in HES data between April 2019 to February 2020 (from before the UK epidemic) means ONS did not have an up to date picture of underlying health conditions. Getting retrospective monthly HES data for this period will fill this gap sooner than waiting for the final annual 2019/20 extract which will be supplied by NHSD in October 2020.
ONS also needs hospital data from during the UK epidemic to have visibility of those who are hospitalised from COVID-19 but then recover. An ongoing monthly supply of HES data will provide ONS with this information much sooner than an annual supply would provide.
Dataset 3: Improving Access to Psychological Therapies (IAPT) Dataset
3.1. To enable research being conducted by ONS’ Administrative Data Census and Migration Statistics improvement projects using ‘activity’ and characteristics data from IAPT.
This first use is essentially the same as described for the uses of HES data within these projects: The IAPT data provides evidence of presence at a particular address, and it also includes information on characteristics including ethnicity. See section 2.1 above (within the HES section) for the full rationale for why this information is needed.
3.2. To conduct a range of Statistical Research and Health Analyses using IAPT data
a. Statistical Research to inform Primary Mental Health Service Policy Making
This project will focus on common mental health disorders (CMDs) such as anxiety and depression. Using a phased approach, ONS will look first at the mortality risk of people with CMDs, co-morbidities between mental and physical health problems, and investigate inequalities around mental health. In the second phase, ONS will investigate income and employment transitions for patients who have been through mental health treatment.
The first phase will address existing evidence gaps on co-morbidities between mental and physical health, improve understanding on the demographics of people with CMDs, and investigate whether some or all people with CMDs are more at risk of death than the general population.
The IAPT data for 2012 to 2017 will be linked to the 2011 Census to provide detailed demographic background, and to death registrations from 2012 to 2018. The mortality analysis will focus on specific causes of death which may be connected to mental health (suicide, alcohol and drug abuse) as well as overall risk. In addition, the causes of death will be compared to the distribution of causes in the general population to identify any common co-morbidity with life-threatening illnesses. This goes some way to provide insight into important issues raised by the NHS England Five Year Forward View on mental health:
“An important barrier to good care is the lack of appropriate data sharing to enable organisations to identify co-morbidities…People with poor mental health may require primary care, secondary physical care and social care, as well as mental health services, but the lack of linked datasets hinders effective provision.”
IAPT data is estimated to cover over 15% of people with CMDs in England. Because of the service’s large, national scale and focus on people with mild and moderate mental health conditions, it provides a reasonable proxy for patterns and trends in the population of people with diagnosable CMDs.
The IAPT data will be compared with the findings of the Adult Psychiatric Morbidity Survey (2007 and 2014) to assess likely issues of representativeness, such as the under-representation of specific population groups in the treatment cohort. People with severe mental health conditions are not typically treated in the IAPT programme.
The three-way linkage will provide an independent and more detailed demographic baseline than the IAPT data could do alone, and allow ONS to investigate if there have been changes in peoples’ circumstances between the Census and treatment in IAPT (e.g. becoming disabled or living alone). Having the mortality data linked as well allows ONS to see the overall trends in mortality, plus to see if there is any relationship between changes in demographics and the cause of death outcomes.
The research is not aiming to look at individual level outcomes or to evaluate the IAPT treatment, but to look for trends in the aggregate data after linkage, to provide population level analysis to inform policy.
Entry into IAPT treatment will be used as the main indicator of having a diagnosable CMD. The clinical data will not be analysed except to:
• Group the cohort into broad types of CMD
• Potentially, link successful/unsuccessful treatment outcome to risk of subsequent death.
b. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released between August and December in a series of themed packages. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison, sometimes back to 1837. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
There are several published packages:
Birth summary tables: includes the number of live births and stillbirths, fertility rates, percentage of live births outside marriage and civil partnership, mean age of mother and percentage of live births to non-UK born mothers for England and Wales as a whole. Live births (number and rate) and the number of stillbirths are also provided down to local authority level. To aid with user interpretation, ONS also publishes an interactive fertility mapping tool, which enables users to analyse trends in fertility by county district and unitary authority; this is contained within the statistical bulletin.
Parents’ country of birth: includes births by country of birth of mother and total fertility rates for UK born and non-UK born women for England and Wales as a whole. Summary figures are also available down to local authority level. ONS publishes detailed analysis on parents’ country of birth because this information is collected at birth registration and does not change over time, while their nationality or ethnicity may change.
Birth characteristics and by area of usual residence: contains statistics on stillbirths and maternities for England and Wales, birthweight data for live and stillbirths by mother's region of usual residence, and live births and stillbirths in hospitals and communal establishments by region of occurrence. These tables also provide figures on month and quarter of occurrence, place of birth, ethnicity and gestational age and multiple births for England and Wales as a whole. Also provides summary data for live births down to local authority level including figures by age of mother figures are published using boundaries in place during the year the birth occurred.
Births by parents’ characteristics: provides live birth, stillbirth and maternity statistics by age of mother and type of registration (within marriage and civil partnership, joint, sole). It also provides data on previous live-born children, National Statistics Socio-economic Classification (NS-SEC), median birth intervals, age-specific fertility rates for men and mean age of fathers. All tables are for England and Wales as a whole with no sub-national breakdown.
Childbearing for women born in different years (formerly known as Cohort fertility): presents data on fertility by year of birth of mother rather than the year of birth of child for England and Wales as a whole this package includes the average number of live-born children and the proportion of women remaining childless for women born in different years.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Dataset 2 and dataset 3: Hospital Episode Statistics and Improving Access to Psychological Therapies data
The initial uses to which ONS will put HES and IAPT data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES or IAPT data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users, and will seek to provide frequent updates on these projects during that first stage.
DARS-NIC-175120-W5G2X-v4.2 25 June 2022 to 8 April 2022
- Title
- D5 - Office for National Statistics requirements for NHS-Digital data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 5
- Files released
- 6
Datasets: Birth Notification Data; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5
What changed from DARS-NIC-175120-W5G2X-v3.3
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2022-06-25 |
Unchanged: Objective for processing, Processing activities, Expected output, Expected measurable benefits.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS Digital, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://www.statisticsauthority.gov.uk/publication/delivering-better-statistics-for-better-decisions-data-access-legislation-march-2016/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters, and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this data sharing agreement. This process involved working closely with NHS Digital’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest, and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS Digital will also publish this data sharing agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS Digital approval . It would also require an appropriate alternative legal gateway, because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS Digital and enter into an amended Data Sharing Agreement before proceeding with that new purpose .
Dataset 1: Birth Notifications data
NHS Digital has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
The birth notifications data contribute to ONS statistical analyses of births, maternities, and infant mortality outcomes. Analyses are made publicly available as aggregate National Statistics. These statistics help a range of public and other bodies make better decisions (see section 5d). They also feed into the Department of Health's NHS Outcomes Framework for monitoring low birthweight of term babies.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics, and ONS become controllers of that data under Section 42 of the 2007 Statistics and Registration Services Act. However, there are some limitations with the GRO data, including a lack of medical information such as length of gestation, as well as some missing and implausible values in the fields that are available.
To mitigate these limitations, the NHS Digital birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. Several identifying variables such as NHS number are received to enable this linkage.
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
ONS also plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link siblings born at different times (i.e. not twins) using the NHS number of the mother which is only available on the notification data. This provides a ‘gold standard’ linkage method.
ONS can then then attempt to link siblings together using only the data available in the registration data – e.g. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the latter linkage method matches the gold standard. This will inform the best matching methodology to use when seeking to link siblings if NHS number of mother is not available. This is needed to link pre-2005 birth registration data, a time when the birth notification data is not available to ONS. This purpose would fall under the Research and development of methodology category in the uses framework above.
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS Digital data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realized.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data based ethnicity estimates will be important when deciding whether to move to an admin data based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS Digital data experts to understand the limitations of the HES ethnicity data and there are several; for example coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘Activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about why people have accessed hospital services, for example diagnosis, for a range of statistical purposes.
This information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, the volume of this information is being minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services will be shared with ONS, compared with the information about when and where people have accessed services.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital, or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly. It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible to develop new measures of avoidable mortality in the elderly.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality. The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments, and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, newborn and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS Digital and Public Health England (PHE) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability and geography. In some cases, NHS Digital / PHE will not hold data that would enable this, but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (2011 Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken by central government, health services and others.
ONS previously held HES data covering up until March 2019 and was to receive annual updates. This is not timely enough to enable all of the aims of the project. The gap in HES data between April 2019 to February 2020 (from before the UK epidemic) means ONS did not have an up to date picture of underlying health conditions. Getting retrospective monthly HES data for this period will fill this gap sooner than waiting for the final annual 2019/20 extract which will be supplied by NHSD in October 2020.
ONS also needs hospital data from during the UK epidemic to have visibility of those who are hospitalised from COVID-19 but then recover. An ongoing monthly supply of HES data will provide ONS with this information much sooner than an annual supply would provide.
Dataset 3: Improving Access to Psychological Therapies (IAPT) Dataset
3.1. To enable research being conducted by ONS’ Administrative Data Census and Migration Statistics improvement projects using ‘activity’ and characteristics data from IAPT.
This first use is essentially the same as described for the uses of HES data within these projects: The IAPT data provides evidence of presence at a particular address, and it also includes information on characteristics including ethnicity. See section 2.1 above (within the HES section) for the full rationale for why this information is needed.
3.2. To conduct a range of Statistical Research and Health Analyses using IAPT data
a. Statistical Research to inform Primary Mental Health Service Policy Making
This project will focus on common mental health disorders (CMDs) such as anxiety and depression. Using a phased approach, ONS will look first at the mortality risk of people with CMDs, co-morbidities between mental and physical health problems, and investigate inequalities around mental health. In the second phase, ONS will investigate income and employment transitions for patients who have been through mental health treatment.
The first phase will address existing evidence gaps on co-morbidities between mental and physical health, improve understanding on the demographics of people with CMDs, and investigate whether some or all people with CMDs are more at risk of death than the general population.
The IAPT data for 2012 to 2017 will be linked to the 2011 Census to provide detailed demographic background, and to death registrations from 2012 to 2018. The mortality analysis will focus on specific causes of death which may be connected to mental health (suicide, alcohol and drug abuse) as well as overall risk. In addition, the causes of death will be compared to the distribution of causes in the general population to identify any common co-morbidity with life-threatening illnesses. This goes some way to provide insight into important issues raised by the NHS England Five Year Forward View on mental health:
“An important barrier to good care is the lack of appropriate data sharing to enable organisations to identify co-morbidities…People with poor mental health may require primary care, secondary physical care and social care, as well as mental health services, but the lack of linked datasets hinders effective provision.”
IAPT data is estimated to cover over 15% of people with CMDs in England. Because of the service’s large, national scale and focus on people with mild and moderate mental health conditions, it provides a reasonable proxy for patterns and trends in the population of people with diagnosable CMDs.
The IAPT data will be compared with the findings of the Adult Psychiatric Morbidity Survey (2007 and 2014) to assess likely issues of representativeness, such as the under-representation of specific population groups in the treatment cohort. People with severe mental health conditions are not typically treated in the IAPT programme.
The three-way linkage will provide an independent and more detailed demographic baseline than the IAPT data could do alone, and allow ONS to investigate if there have been changes in peoples’ circumstances between the Census and treatment in IAPT (e.g. becoming disabled or living alone). Having the mortality data linked as well allows ONS to see the overall trends in mortality, plus to see if there is any relationship between changes in demographics and the cause of death outcomes.
The research is not aiming to look at individual level outcomes or to evaluate the IAPT treatment, but to look for trends in the aggregate data after linkage, to provide population level analysis to inform policy.
Entry into IAPT treatment will be used as the main indicator of having a diagnosable CMD. The clinical data will not be analysed except to:
• Group the cohort into broad types of CMD
• Potentially, link successful/unsuccessful treatment outcome to risk of subsequent death.
b. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released between August and December in a series of themed packages. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison, sometimes back to 1837. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
There are several published packages:
Birth summary tables: includes the number of live births and stillbirths, fertility rates, percentage of live births outside marriage and civil partnership, mean age of mother and percentage of live births to non-UK born mothers for England and Wales as a whole. Live births (number and rate) and the number of stillbirths are also provided down to local authority level. To aid with user interpretation, ONS also publishes an interactive fertility mapping tool, which enables users to analyse trends in fertility by county district and unitary authority; this is contained within the statistical bulletin.
Parents’ country of birth: includes births by country of birth of mother and total fertility rates for UK born and non-UK born women for England and Wales as a whole. Summary figures are also available down to local authority level. ONS publishes detailed analysis on parents’ country of birth because this information is collected at birth registration and does not change over time, while their nationality or ethnicity may change.
Birth characteristics and by area of usual residence: contains statistics on stillbirths and maternities for England and Wales, birthweight data for live and stillbirths by mother's region of usual residence, and live births and stillbirths in hospitals and communal establishments by region of occurrence. These tables also provide figures on month and quarter of occurrence, place of birth, ethnicity and gestational age and multiple births for England and Wales as a whole. Also provides summary data for live births down to local authority level including figures by age of mother figures are published using boundaries in place during the year the birth occurred.
Births by parents’ characteristics: provides live birth, stillbirth and maternity statistics by age of mother and type of registration (within marriage and civil partnership, joint, sole). It also provides data on previous live-born children, National Statistics Socio-economic Classification (NS-SEC), median birth intervals, age-specific fertility rates for men and mean age of fathers. All tables are for England and Wales as a whole with no sub-national breakdown.
Childbearing for women born in different years (formerly known as Cohort fertility): presents data on fertility by year of birth of mother rather than the year of birth of child for England and Wales as a whole this package includes the average number of live-born children and the proportion of women remaining childless for women born in different years.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Dataset 2 and dataset 3: Hospital Episode Statistics and Improving Access to Psychological Therapies data
The initial uses to which ONS will put HES and IAPT data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES or IAPT data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users, and will seek to provide frequent updates on these projects during that first stage.
DARS-NIC-175120-W5G2X-v3.3 1 June 2020 to 8 April 2022
- Title
- D5 - Office for National Statistics requirements for NHS-Digital data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 5
- Files released
- 4
Datasets: Birth Notification Data; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5
What changed from DARS-NIC-175120-W5G2X-v2.3
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Title | D5 - Office for National Statistics requirements for NHS-Digital data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017 | |
| Start date | 2020-06-01 |
Objective for processing
[103 paragraphs unchanged]
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (2011 Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken by central government, health services and others.
ONS previously held HES data covering up until March 2019 and was to receive annual updates. This is not timely enough to enable all of the aims of the project. The gap in HES data between April 2019 to February 2020 (from before the UK epidemic) means ONS did not have an up to date picture of underlying health conditions. Getting retrospective monthly HES data for this period will fill this gap sooner than waiting for the final annual 2019/20 extract which will be supplied by NHSD in October 2020.
ONS also needs hospital data from during the UK epidemic to have visibility of those who are hospitalised from COVID-19 but then recover. An ongoing monthly supply of HES data will provide ONS with this information much sooner than an annual supply would provide.
[17 paragraphs unchanged]
The State pension age review, 2017, called for more work on healthy
[20 words unchanged]
in informing planning future health and social care provision at a local
and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and IAPT data could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data to make inferences about the health of the population. However, ONS will investigate the possibilities of IAPT data contributing to more complete estimation of morbidity, to then use alongside mortality data and other relevant sources in health projection modelling. This assessment of morbidity would be in conjunction with other sources such as NHS Digital’s Hospital Episode Statistics (HES) that the Board has already required be shared with ONS.
c. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions, would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking IAPT data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual
Unchanged: Processing activities, Expected output, Expected measurable benefits.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS Digital, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://www.statisticsauthority.gov.uk/publication/delivering-better-statistics-for-better-decisions-data-access-legislation-march-2016/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters, and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this data sharing agreement. This process involved working closely with NHS Digital’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest, and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS Digital will also publish this data sharing agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS Digital approval . It would also require an appropriate alternative legal gateway, because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS Digital and enter into an amended Data Sharing Agreement before proceeding with that new purpose .
Dataset 1: Birth Notifications data
NHS Digital has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
The birth notifications data contribute to ONS statistical analyses of births, maternities, and infant mortality outcomes. Analyses are made publicly available as aggregate National Statistics. These statistics help a range of public and other bodies make better decisions (see section 5d). They also feed into the Department of Health's NHS Outcomes Framework for monitoring low birthweight of term babies.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics, and ONS become controllers of that data under Section 42 of the 2007 Statistics and Registration Services Act. However, there are some limitations with the GRO data, including a lack of medical information such as length of gestation, as well as some missing and implausible values in the fields that are available.
To mitigate these limitations, the NHS Digital birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. Several identifying variables such as NHS number are received to enable this linkage.
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
ONS also plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link siblings born at different times (i.e. not twins) using the NHS number of the mother which is only available on the notification data. This provides a ‘gold standard’ linkage method.
ONS can then then attempt to link siblings together using only the data available in the registration data – e.g. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the latter linkage method matches the gold standard. This will inform the best matching methodology to use when seeking to link siblings if NHS number of mother is not available. This is needed to link pre-2005 birth registration data, a time when the birth notification data is not available to ONS. This purpose would fall under the Research and development of methodology category in the uses framework above.
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS Digital data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realized.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data based ethnicity estimates will be important when deciding whether to move to an admin data based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS Digital data experts to understand the limitations of the HES ethnicity data and there are several; for example coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘Activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about why people have accessed hospital services, for example diagnosis, for a range of statistical purposes.
This information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, the volume of this information is being minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services will be shared with ONS, compared with the information about when and where people have accessed services.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital, or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly. It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible to develop new measures of avoidable mortality in the elderly.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality. The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments, and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, newborn and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS Digital and Public Health England (PHE) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability and geography. In some cases, NHS Digital / PHE will not hold data that would enable this, but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
2.6. Rapid response project to investigate the socio-economic factors and underlying health conditions associated with worse outcomes from contracting the COVID-19 virus
Hospital episodes linked to COVID-19 allows ONS to identify incidences where people are hospitalised but recover, filling a key gap in visibility of cases. This will be used as part of a large scale COVID-19 linkage project. Data will be linked to data on Deaths, demographics (2011 Census) and primary care data to establish and assess commodities and risk factors associated with COVID-19.
This is of critical priority across government as part of the UK’s response to the COVID-19 pandemic. This will contribute to the wider understanding of the virus, helping to inform a range of policy decisions taken by central government, health services and others.
ONS previously held HES data covering up until March 2019 and was to receive annual updates. This is not timely enough to enable all of the aims of the project. The gap in HES data between April 2019 to February 2020 (from before the UK epidemic) means ONS did not have an up to date picture of underlying health conditions. Getting retrospective monthly HES data for this period will fill this gap sooner than waiting for the final annual 2019/20 extract which will be supplied by NHSD in October 2020.
ONS also needs hospital data from during the UK epidemic to have visibility of those who are hospitalised from COVID-19 but then recover. An ongoing monthly supply of HES data will provide ONS with this information much sooner than an annual supply would provide.
Dataset 3: Improving Access to Psychological Therapies (IAPT) Dataset
3.1. To enable research being conducted by ONS’ Administrative Data Census and Migration Statistics improvement projects using ‘activity’ and characteristics data from IAPT.
This first use is essentially the same as described for the uses of HES data within these projects: The IAPT data provides evidence of presence at a particular address, and it also includes information on characteristics including ethnicity. See section 2.1 above (within the HES section) for the full rationale for why this information is needed.
3.2. To conduct a range of Statistical Research and Health Analyses using IAPT data
a. Statistical Research to inform Primary Mental Health Service Policy Making
This project will focus on common mental health disorders (CMDs) such as anxiety and depression. Using a phased approach, ONS will look first at the mortality risk of people with CMDs, co-morbidities between mental and physical health problems, and investigate inequalities around mental health. In the second phase, ONS will investigate income and employment transitions for patients who have been through mental health treatment.
The first phase will address existing evidence gaps on co-morbidities between mental and physical health, improve understanding on the demographics of people with CMDs, and investigate whether some or all people with CMDs are more at risk of death than the general population.
The IAPT data for 2012 to 2017 will be linked to the 2011 Census to provide detailed demographic background, and to death registrations from 2012 to 2018. The mortality analysis will focus on specific causes of death which may be connected to mental health (suicide, alcohol and drug abuse) as well as overall risk. In addition, the causes of death will be compared to the distribution of causes in the general population to identify any common co-morbidity with life-threatening illnesses. This goes some way to provide insight into important issues raised by the NHS England Five Year Forward View on mental health:
“An important barrier to good care is the lack of appropriate data sharing to enable organisations to identify co-morbidities…People with poor mental health may require primary care, secondary physical care and social care, as well as mental health services, but the lack of linked datasets hinders effective provision.”
IAPT data is estimated to cover over 15% of people with CMDs in England. Because of the service’s large, national scale and focus on people with mild and moderate mental health conditions, it provides a reasonable proxy for patterns and trends in the population of people with diagnosable CMDs.
The IAPT data will be compared with the findings of the Adult Psychiatric Morbidity Survey (2007 and 2014) to assess likely issues of representativeness, such as the under-representation of specific population groups in the treatment cohort. People with severe mental health conditions are not typically treated in the IAPT programme.
The three-way linkage will provide an independent and more detailed demographic baseline than the IAPT data could do alone, and allow ONS to investigate if there have been changes in peoples’ circumstances between the Census and treatment in IAPT (e.g. becoming disabled or living alone). Having the mortality data linked as well allows ONS to see the overall trends in mortality, plus to see if there is any relationship between changes in demographics and the cause of death outcomes.
The research is not aiming to look at individual level outcomes or to evaluate the IAPT treatment, but to look for trends in the aggregate data after linkage, to provide population level analysis to inform policy.
Entry into IAPT treatment will be used as the main indicator of having a diagnosable CMD. The clinical data will not be analysed except to:
• Group the cohort into broad types of CMD
• Potentially, link successful/unsuccessful treatment outcome to risk of subsequent death.
b. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released between August and December in a series of themed packages. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison, sometimes back to 1837. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
There are several published packages:
Birth summary tables: includes the number of live births and stillbirths, fertility rates, percentage of live births outside marriage and civil partnership, mean age of mother and percentage of live births to non-UK born mothers for England and Wales as a whole. Live births (number and rate) and the number of stillbirths are also provided down to local authority level. To aid with user interpretation, ONS also publishes an interactive fertility mapping tool, which enables users to analyse trends in fertility by county district and unitary authority; this is contained within the statistical bulletin.
Parents’ country of birth: includes births by country of birth of mother and total fertility rates for UK born and non-UK born women for England and Wales as a whole. Summary figures are also available down to local authority level. ONS publishes detailed analysis on parents’ country of birth because this information is collected at birth registration and does not change over time, while their nationality or ethnicity may change.
Birth characteristics and by area of usual residence: contains statistics on stillbirths and maternities for England and Wales, birthweight data for live and stillbirths by mother's region of usual residence, and live births and stillbirths in hospitals and communal establishments by region of occurrence. These tables also provide figures on month and quarter of occurrence, place of birth, ethnicity and gestational age and multiple births for England and Wales as a whole. Also provides summary data for live births down to local authority level including figures by age of mother figures are published using boundaries in place during the year the birth occurred.
Births by parents’ characteristics: provides live birth, stillbirth and maternity statistics by age of mother and type of registration (within marriage and civil partnership, joint, sole). It also provides data on previous live-born children, National Statistics Socio-economic Classification (NS-SEC), median birth intervals, age-specific fertility rates for men and mean age of fathers. All tables are for England and Wales as a whole with no sub-national breakdown.
Childbearing for women born in different years (formerly known as Cohort fertility): presents data on fertility by year of birth of mother rather than the year of birth of child for England and Wales as a whole this package includes the average number of live-born children and the proportion of women remaining childless for women born in different years.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Dataset 2 and dataset 3: Hospital Episode Statistics and Improving Access to Psychological Therapies data
The initial uses to which ONS will put HES and IAPT data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES or IAPT data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users, and will seek to provide frequent updates on these projects during that first stage.
DARS-NIC-175120-W5G2X-v2.3 17 June 2019 to 8 April 2022
- Title
- Office for National Statistics requirements for NHS-Digital data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 5
- Files released
- 35
Datasets: Birth Notification Data; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP); Improving Access to Psychological Therapies (IAPT) v1.5
What changed from DARS-NIC-175120-W5G2X-v1.3
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2019-06-17 | |
| Birth Notification Data: type of data | Identifiable | |
| Birth Notification Data: common law duty of confidentiality | Statutory exemption to flow confidential data without consent | |
| Hospital Episode Statistics Accident and Emergency (HES A and E): common law duty of confidentiality | Statutory exemption to flow confidential data without consent | |
| Hospital Episode Statistics Admitted Patient Care (HES APC): common law duty of confidentiality | Statutory exemption to flow confidential data without consent | |
| Hospital Episode Statistics Outpatients (HES OP): common law duty of confidentiality | Statutory exemption to flow confidential data without consent |
Datasets: + Improving Access to Psychological Therapies Data Set_v1.5
Objective for processing
[101 paragraphs unchanged]
ONS’s SDGs team are working with NHS Digital and Public Health England
(PHE)to
(PHE) to
produce these indicators without the need for data sharing. However, ONS also
[37 words unchanged]
as from Census 2011 at an individual level may fill this gap.
[1 paragraph unchanged]
Dataset 3: Improving Access to Psychological Therapies (IAPT) Dataset
3.1. To enable research being conducted by ONS’ Administrative Data Census and Migration Statistics improvement projects using ‘activity’ and characteristics data from IAPT.
This first use is essentially the same as described for the uses of HES data within these projects: The IAPT data provides evidence of presence at a particular address, and it also includes information on characteristics including ethnicity. See section 2.1 above (within the HES section) for the full rationale for why this information is needed.
3.2. To conduct a range of Statistical Research and Health Analyses using IAPT data
a. Statistical Research to inform Primary Mental Health Service Policy Making
This project will focus on common mental health disorders (CMDs) such as anxiety and depression. Using a phased approach, ONS will look first at the mortality risk of people with CMDs, co-morbidities between mental and physical health problems, and investigate inequalities around mental health. In the second phase, ONS will investigate income and employment transitions for patients who have been through mental health treatment.
The first phase will address existing evidence gaps on co-morbidities between mental and physical health, improve understanding on the demographics of people with CMDs, and investigate whether some or all people with CMDs are more at risk of death than the general population.
The IAPT data for 2012 to 2017 will be linked to the 2011 Census to provide detailed demographic background, and to death registrations from 2012 to 2018. The mortality analysis will focus on specific causes of death which may be connected to mental health (suicide, alcohol and drug abuse) as well as overall risk. In addition, the causes of death will be compared to the distribution of causes in the general population to identify any common co-morbidity with life-threatening illnesses. This goes some way to provide insight into important issues raised by the NHS England Five Year Forward View on mental health:
“An important barrier to good care is the lack of appropriate data sharing to enable organisations to identify co-morbidities…People with poor mental health may require primary care, secondary physical care and social care, as well as mental health services, but the lack of linked datasets hinders effective provision.”
IAPT data is estimated to cover over 15% of people with CMDs in England. Because of the service’s large, national scale and focus on people with mild and moderate mental health conditions, it provides a reasonable proxy for patterns and trends in the population of people with diagnosable CMDs.
The IAPT data will be compared with the findings of the Adult Psychiatric Morbidity Survey (2007 and 2014) to assess likely issues of representativeness, such as the under-representation of specific population groups in the treatment cohort. People with severe mental health conditions are not typically treated in the IAPT programme.
The three-way linkage will provide an independent and more detailed demographic baseline than the IAPT data could do alone, and allow ONS to investigate if there have been changes in peoples’ circumstances between the Census and treatment in IAPT (e.g. becoming disabled or living alone). Having the mortality data linked as well allows ONS to see the overall trends in mortality, plus to see if there is any relationship between changes in demographics and the cause of death outcomes.
The research is not aiming to look at individual level outcomes or to evaluate the IAPT treatment, but to look for trends in the aggregate data after linkage, to provide population level analysis to inform policy.
Entry into IAPT treatment will be used as the main indicator of having a diagnosable CMD. The clinical data will not be analysed except to:
• Group the cohort into broad types of CMD
• Potentially, link successful/unsuccessful treatment outcome to risk of subsequent death.
b. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and IAPT data could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data to make inferences about the health of the population. However, ONS will investigate the possibilities of IAPT data contributing to more complete estimation of morbidity, to then use alongside mortality data and other relevant sources in health projection modelling. This assessment of morbidity would be in conjunction with other sources such as NHS Digital’s Hospital Episode Statistics (HES) that the Board has already required be shared with ONS.
c. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions, would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking IAPT data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual
Processing activities
[12 paragraphs unchanged]
Dataset
2:
2 and 3:
Hospital Episode Statistics (HES)
and Improving Access to Psychological Therapies (IAPT) data
[1 paragraph unchanged]
• Need To
Know
Access
applied through user account access and management
. Access to the data is restricted to individuals granted access on the basis of a justified need to access the data
• Controlled ingest and export of data into/out from the
DAP
environment
[1 paragraph unchanged]
• Logged and monitored access of user activity within the
DAP
environment
[13 paragraphs unchanged]
Inadvertent re-identification is still a risk but ONS will never seek to intentionally re-identify this data. ONS staff are suitably trained; for
example,
example
ONS’s health analysts in particular are experienced working with sensitive data about
[24 words unchanged]
In other words, other than the initial transfer of the data from
NHS-Digital
NHS Digital
to ONS, the identifiable data will never be in transit and will
[12 words unchanged]
to be implemented by 31/12/2019 to enforce the controls as described above.
[8 paragraphs unchanged]
The clearest example of the need for the information in this agreement
[33 words unchanged]
products that cover the whole of England (and beyond), so complete HES
and IAPT
coverage is required. In addition, a decision is required post-2021 Census about
[58 words unchanged]
them to the gold standard Census figures available for 2011 and 2021.
For the health analysis purposes presented in section 5a that require why
[79 words unchanged]
is proportionate and in the public interest that the years worth of
HES
diagnosis information required is minimised for now. It will still be possible to test statistical quality for these uses with this volume of information. But
we
ONS
do expect this work to be successful and if it is ONS will require additional years of diagnosis information be shared at a later date.
Access to data held within the Data Access Platform (DAP), which includes HES data, is granted to users on a need-to-know basis depending on their role, through a request process which provides a business justification. Access is authorised on a case-by-case basis by the ONS Information Asset Owner (IAO) responsible for HES data, with advice from Security and Information Management. Staff requesting access to HES data must be cleared to the appropriate National Vetting level, which is higher than the standard basic clearance required for all ONS staff. Only authorised ONS staff with appropriate security clearance will have access to identifiable HES data, with regular audit and monitoring in place to ensure compliance
Expected output
[10 paragraphs unchanged]
Dataset
2:
2 and dataset 3:
Hospital Episode Statistics
and Improving Access to Psychological Therapies data
The initial uses to which ONS will put HES
and IAPT
data are most commonly new or improved official statistics that will enable
[26 words unchanged]
whether official statistics of sufficient quality can be produced in each case.
[6 paragraphs unchanged]
No targets can be given as to if and when experimental or National Statistics will be produced using HES
or IAPT
data until the initial stage of any given project is complete. All
[9 words unchanged]
seek to provide frequent updates on these projects during that first stage.
Expected measurable benefits
As per section 5a, the legal gateway under which data will flow from
NHS-D
NHS Digital
to ONS will be Section 45c of the SRSA 2007 (as amended
[29 words unchanged]
in line with the statistical statement of principles that underpins these powers.
These considerations include that the purposes to which ONS puts the data
[26 words unchanged]
social care specifically. This is unlike some other legal gateways under which
NHS-D
NHS Digital
data can be disseminated, for example section 251 of the NHS Act 2006, when research outcomes must benefit health and social care.
[35 paragraphs unchanged]
Dataset 3: Benefits of the uses for IAPT data
3.1. Benefits of the Admin Data Census project and improved migration statistics
This is essentially the same as described for the uses of HES data within ONS’ Admin Data Census Project. See section 2.1 above (within the HES section) for benefits of these uses.
3.2. Benefits of Statistical Research and Health Analyses using IAPT data
Mental health is a high priority in government policy. Co-morbidities between mental and physical health, as well as inequalities in mental health, are of increasing interest within health policy.
In their response to the Five Year Forward View (FYFV), NHS England set an objective for the majority of new common mental health disorder (CMD) services to be integrated with physical healthcare by 2020/21. This is in line with a King’s Fund report which provided evidence for the strong links between mental and physical health.
This project will add to the evidence base by:
• providing information on many physical conditions (rather than a focus on only a few key health problems, as in the Adult Psychiatric Morbidity Survey)
• providing a detailed demographic context, including information such as ethnicity, sexual orientation, occupation, marital status
• Investigating inequalities
Investigating the links between mental health, mortality, and co-morbidity has clear benefits for the public. By determining physical and mental health conditions that commonly co-occur, the government can target its health services to better meet the needs of patients resulting in a better patient experience, and ultimately could saves lives. For example, it may be that a particular cause of death has an increased prevalence in patients with CMD compared to the general population; by ensuring policy makers and clinical staff are aware of this, prevention and intervention could be more targeted.
The second benefit of the project is analysis of inequalities in mental health, in line with the FYFV “focus on tackling inequalities. Mental health problems disproportionately affect people living in poverty, those who are unemployed and who already face discrimination”. The King’s Fund found that people with long term physical health problems and co-morbid mental illness disproportionately live in deprived areas. This analysis would allow detailed geographical mapping of those with a CMD who died from particular causes, and analysis by deprivation deciles.
Other demographic variables could also be used for inequalities analysis to investigate any difference in premature mortality in certain demographic groups of IAPT users (age, sex, or occupation) versus the general population. Obtaining this information will benefit the public by allowing healthcare providers to target groups who may be disproportionately affected by physical and mental health problems, and subsequently reduce premature mortality due to co-morbidities.
The benefits of the other health statistics mentioned in section 5a (3.2) to which IAPT data will contribute are already described under the benefits gained from ONS acquiring HES data.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS Digital, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://www.statisticsauthority.gov.uk/publication/delivering-better-statistics-for-better-decisions-data-access-legislation-march-2016/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters, and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this data sharing agreement. This process involved working closely with NHS Digital’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest, and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS Digital will also publish this data sharing agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS Digital approval . It would also require an appropriate alternative legal gateway, because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS Digital and enter into an amended Data Sharing Agreement before proceeding with that new purpose .
Dataset 1: Birth Notifications data
NHS Digital has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
The birth notifications data contribute to ONS statistical analyses of births, maternities, and infant mortality outcomes. Analyses are made publicly available as aggregate National Statistics. These statistics help a range of public and other bodies make better decisions (see section 5d). They also feed into the Department of Health's NHS Outcomes Framework for monitoring low birthweight of term babies.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics, and ONS become controllers of that data under Section 42 of the 2007 Statistics and Registration Services Act. However, there are some limitations with the GRO data, including a lack of medical information such as length of gestation, as well as some missing and implausible values in the fields that are available.
To mitigate these limitations, the NHS Digital birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. Several identifying variables such as NHS number are received to enable this linkage.
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
ONS also plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link siblings born at different times (i.e. not twins) using the NHS number of the mother which is only available on the notification data. This provides a ‘gold standard’ linkage method.
ONS can then then attempt to link siblings together using only the data available in the registration data – e.g. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the latter linkage method matches the gold standard. This will inform the best matching methodology to use when seeking to link siblings if NHS number of mother is not available. This is needed to link pre-2005 birth registration data, a time when the birth notification data is not available to ONS. This purpose would fall under the Research and development of methodology category in the uses framework above.
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS Digital data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realized.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data based ethnicity estimates will be important when deciding whether to move to an admin data based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS Digital data experts to understand the limitations of the HES ethnicity data and there are several; for example coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘Activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about why people have accessed hospital services, for example diagnosis, for a range of statistical purposes.
This information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, the volume of this information is being minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services will be shared with ONS, compared with the information about when and where people have accessed services.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital, or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly. It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible to develop new measures of avoidable mortality in the elderly.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality. The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments, and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, newborn and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS Digital and Public Health England (PHE) to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability and geography. In some cases, NHS Digital / PHE will not hold data that would enable this, but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
Dataset 3: Improving Access to Psychological Therapies (IAPT) Dataset
3.1. To enable research being conducted by ONS’ Administrative Data Census and Migration Statistics improvement projects using ‘activity’ and characteristics data from IAPT.
This first use is essentially the same as described for the uses of HES data within these projects: The IAPT data provides evidence of presence at a particular address, and it also includes information on characteristics including ethnicity. See section 2.1 above (within the HES section) for the full rationale for why this information is needed.
3.2. To conduct a range of Statistical Research and Health Analyses using IAPT data
a. Statistical Research to inform Primary Mental Health Service Policy Making
This project will focus on common mental health disorders (CMDs) such as anxiety and depression. Using a phased approach, ONS will look first at the mortality risk of people with CMDs, co-morbidities between mental and physical health problems, and investigate inequalities around mental health. In the second phase, ONS will investigate income and employment transitions for patients who have been through mental health treatment.
The first phase will address existing evidence gaps on co-morbidities between mental and physical health, improve understanding on the demographics of people with CMDs, and investigate whether some or all people with CMDs are more at risk of death than the general population.
The IAPT data for 2012 to 2017 will be linked to the 2011 Census to provide detailed demographic background, and to death registrations from 2012 to 2018. The mortality analysis will focus on specific causes of death which may be connected to mental health (suicide, alcohol and drug abuse) as well as overall risk. In addition, the causes of death will be compared to the distribution of causes in the general population to identify any common co-morbidity with life-threatening illnesses. This goes some way to provide insight into important issues raised by the NHS England Five Year Forward View on mental health:
“An important barrier to good care is the lack of appropriate data sharing to enable organisations to identify co-morbidities…People with poor mental health may require primary care, secondary physical care and social care, as well as mental health services, but the lack of linked datasets hinders effective provision.”
IAPT data is estimated to cover over 15% of people with CMDs in England. Because of the service’s large, national scale and focus on people with mild and moderate mental health conditions, it provides a reasonable proxy for patterns and trends in the population of people with diagnosable CMDs.
The IAPT data will be compared with the findings of the Adult Psychiatric Morbidity Survey (2007 and 2014) to assess likely issues of representativeness, such as the under-representation of specific population groups in the treatment cohort. People with severe mental health conditions are not typically treated in the IAPT programme.
The three-way linkage will provide an independent and more detailed demographic baseline than the IAPT data could do alone, and allow ONS to investigate if there have been changes in peoples’ circumstances between the Census and treatment in IAPT (e.g. becoming disabled or living alone). Having the mortality data linked as well allows ONS to see the overall trends in mortality, plus to see if there is any relationship between changes in demographics and the cause of death outcomes.
The research is not aiming to look at individual level outcomes or to evaluate the IAPT treatment, but to look for trends in the aggregate data after linkage, to provide population level analysis to inform policy.
Entry into IAPT treatment will be used as the main indicator of having a diagnosable CMD. The clinical data will not be analysed except to:
• Group the cohort into broad types of CMD
• Potentially, link successful/unsuccessful treatment outcome to risk of subsequent death.
b. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and IAPT data could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data to make inferences about the health of the population. However, ONS will investigate the possibilities of IAPT data contributing to more complete estimation of morbidity, to then use alongside mortality data and other relevant sources in health projection modelling. This assessment of morbidity would be in conjunction with other sources such as NHS Digital’s Hospital Episode Statistics (HES) that the Board has already required be shared with ONS.
c. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions, would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking IAPT data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released between August and December in a series of themed packages. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison, sometimes back to 1837. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
There are several published packages:
Birth summary tables: includes the number of live births and stillbirths, fertility rates, percentage of live births outside marriage and civil partnership, mean age of mother and percentage of live births to non-UK born mothers for England and Wales as a whole. Live births (number and rate) and the number of stillbirths are also provided down to local authority level. To aid with user interpretation, ONS also publishes an interactive fertility mapping tool, which enables users to analyse trends in fertility by county district and unitary authority; this is contained within the statistical bulletin.
Parents’ country of birth: includes births by country of birth of mother and total fertility rates for UK born and non-UK born women for England and Wales as a whole. Summary figures are also available down to local authority level. ONS publishes detailed analysis on parents’ country of birth because this information is collected at birth registration and does not change over time, while their nationality or ethnicity may change.
Birth characteristics and by area of usual residence: contains statistics on stillbirths and maternities for England and Wales, birthweight data for live and stillbirths by mother's region of usual residence, and live births and stillbirths in hospitals and communal establishments by region of occurrence. These tables also provide figures on month and quarter of occurrence, place of birth, ethnicity and gestational age and multiple births for England and Wales as a whole. Also provides summary data for live births down to local authority level including figures by age of mother figures are published using boundaries in place during the year the birth occurred.
Births by parents’ characteristics: provides live birth, stillbirth and maternity statistics by age of mother and type of registration (within marriage and civil partnership, joint, sole). It also provides data on previous live-born children, National Statistics Socio-economic Classification (NS-SEC), median birth intervals, age-specific fertility rates for men and mean age of fathers. All tables are for England and Wales as a whole with no sub-national breakdown.
Childbearing for women born in different years (formerly known as Cohort fertility): presents data on fertility by year of birth of mother rather than the year of birth of child for England and Wales as a whole this package includes the average number of live-born children and the proportion of women remaining childless for women born in different years.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Dataset 2 and dataset 3: Hospital Episode Statistics and Improving Access to Psychological Therapies data
The initial uses to which ONS will put HES and IAPT data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES or IAPT data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users, and will seek to provide frequent updates on these projects during that first stage.
DARS-NIC-175120-W5G2X-v1.3 9 April 2019 to 8 April 2022
- Title
- Office for National Statistics requirements for NHS-Digital data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 4
- Files released
- 0
Datasets: Birth Notification Data; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP)
What changed from DARS-NIC-175120-W5G2X-v0.10
Text removed is struck through; text added is underlined. Unchanged paragraphs are summarised rather than repeated.
| Field | Was | Became |
|---|---|---|
| Start date | 2019-04-09 | |
| End date | 2022-04-08 | |
| Birth Notification Data: sensitivity | Non-Sensitive | |
| Birth Notification Data: type of data | Anonymised - ICO Code Compliant |
Objective for processing
[29 paragraphs unchanged]
The data shared with ONS under this agreement will not be onwardly
[24 words unchanged]
Statistics Analysis Guide. Any exceptions to this would require additional NHS Digital
approval.
approval .
It would also require an appropriate alternative legal gateway, because section 45c
[15 words unchanged]
shared with ONS (not for example, other Government departments or academic researchers).
[1 paragraph unchanged]
In future, ONS may decide to put a dataset to new uses
[24 words unchanged]
enter into an amended Data Sharing Agreement before proceeding with that new
purpose.
purpose .
[59 paragraphs unchanged]
The data may also be
sued
used
to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
[11 paragraphs unchanged]
Processing activities
[1 paragraph unchanged]
ONS receives the data in real time through its Spine2 connection from
[20 words unchanged]
secure server for processing. Here, it is processed ready for ONS use.
This server is separate to those which are used for other datasets from NHS Digital, due to the long-standing nature of this data share.
[27 paragraphs unchanged]
As described in section 5a, the proposed purposes require linkage of records
[33 words unchanged]
uncover trends and other useful insights based on the non-identifiable ‘attribute’ information.
In addition to the system protocols above, ONS will therefore keep the number of staff with access to identifiers to an absolute minimum, and these staff will have a higher level of clearance. All other staff will only have access to de-identified datasets that have already been linked by the security cleared and trained staff mentioned, or have been assigned non-identifiable ONS unique IDs so that they can subsequently be linked with other de-identified datasets coded with the same unique IDs.
Inadvertent re-identification is still a risk but ONS will never seek to intentionally re-identify this data. ONS staff are suitably trained; for example ONS’s health analysts in particular are experienced working with sensitive data about deaths (such as individual level data about suicides). Further, only statistical disclosure controlled aggregate outputs will be exportable from the secure data analysis environment. In other words, other than the initial transfer of the data from NHS-Digital to ONS, the identifiable data will never be in transit and will always be protected by the technical and procedural controls described above.
ONS is in the process of enhancing the capabilities of its Data Access Platform to allow for variable-by-variable control of researcher access granting. Until this is completed, any analyst who is granted access to the dataset will technically have access to all variables and identifiers. However, users will not be permitted to access identifiers for the purposes of analysis. In addition to the system protocols above, ONS will therefore keep the number of staff permitted to process identifiers to an absolute minimum, and these staff will have a higher level of clearance. All other staff will only be permitted to access non-identifying data.
Inadvertent re-identification is still a risk but ONS will never seek to intentionally re-identify this data. ONS staff are suitably trained; for example, ONS’s health analysts in particular are experienced working with sensitive data about deaths (such as individual level data about suicides). Further, only statistical disclosure controlled aggregate outputs will be exportable from the secure data analysis environment. In other words, other than the initial transfer of the data from NHS-Digital to ONS, the identifiable data will never be in transit and will always be protected by procedural controls in place now and technical controls to be implemented by 31/12/2019 to enforce the controls as described above.
[10 paragraphs unchanged]
Benefits reported
Stated in the previous version and removed here.
Yielded Benefits is not a requirement for new applications.
Unchanged: Expected output, Expected measurable benefits.
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS Digital, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://www.statisticsauthority.gov.uk/publication/delivering-better-statistics-for-better-decisions-data-access-legislation-march-2016/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters, and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this data sharing agreement. This process involved working closely with NHS Digital’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest, and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS Digital will also publish this data sharing agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS Digital approval . It would also require an appropriate alternative legal gateway, because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS Digital and enter into an amended Data Sharing Agreement before proceeding with that new purpose .
Dataset 1: Birth Notifications data
NHS Digital has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
The birth notifications data contribute to ONS statistical analyses of births, maternities, and infant mortality outcomes. Analyses are made publicly available as aggregate National Statistics. These statistics help a range of public and other bodies make better decisions (see section 5d). They also feed into the Department of Health's NHS Outcomes Framework for monitoring low birthweight of term babies.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics, and ONS become controllers of that data under Section 42 of the 2007 Statistics and Registration Services Act. However, there are some limitations with the GRO data, including a lack of medical information such as length of gestation, as well as some missing and implausible values in the fields that are available.
To mitigate these limitations, the NHS Digital birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. Several identifying variables such as NHS number are received to enable this linkage.
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
ONS also plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link siblings born at different times (i.e. not twins) using the NHS number of the mother which is only available on the notification data. This provides a ‘gold standard’ linkage method.
ONS can then then attempt to link siblings together using only the data available in the registration data – e.g. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the latter linkage method matches the gold standard. This will inform the best matching methodology to use when seeking to link siblings if NHS number of mother is not available. This is needed to link pre-2005 birth registration data, a time when the birth notification data is not available to ONS. This purpose would fall under the Research and development of methodology category in the uses framework above.
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS Digital data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realized.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data based ethnicity estimates will be important when deciding whether to move to an admin data based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS Digital data experts to understand the limitations of the HES ethnicity data and there are several; for example coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘Activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about why people have accessed hospital services, for example diagnosis, for a range of statistical purposes.
This information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, the volume of this information is being minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services will be shared with ONS, compared with the information about when and where people have accessed services.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital, or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly. It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible to develop new measures of avoidable mortality in the elderly.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality. The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments, and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be used to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, newborn and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS Digital and Public Health England (PHE)to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability and geography. In some cases, NHS Digital / PHE will not hold data that would enable this, but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released between August and December in a series of themed packages. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison, sometimes back to 1837. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
There are several published packages:
Birth summary tables: includes the number of live births and stillbirths, fertility rates, percentage of live births outside marriage and civil partnership, mean age of mother and percentage of live births to non-UK born mothers for England and Wales as a whole. Live births (number and rate) and the number of stillbirths are also provided down to local authority level. To aid with user interpretation, ONS also publishes an interactive fertility mapping tool, which enables users to analyse trends in fertility by county district and unitary authority; this is contained within the statistical bulletin.
Parents’ country of birth: includes births by country of birth of mother and total fertility rates for UK born and non-UK born women for England and Wales as a whole. Summary figures are also available down to local authority level. ONS publishes detailed analysis on parents’ country of birth because this information is collected at birth registration and does not change over time, while their nationality or ethnicity may change.
Birth characteristics and by area of usual residence: contains statistics on stillbirths and maternities for England and Wales, birthweight data for live and stillbirths by mother's region of usual residence, and live births and stillbirths in hospitals and communal establishments by region of occurrence. These tables also provide figures on month and quarter of occurrence, place of birth, ethnicity and gestational age and multiple births for England and Wales as a whole. Also provides summary data for live births down to local authority level including figures by age of mother figures are published using boundaries in place during the year the birth occurred.
Births by parents’ characteristics: provides live birth, stillbirth and maternity statistics by age of mother and type of registration (within marriage and civil partnership, joint, sole). It also provides data on previous live-born children, National Statistics Socio-economic Classification (NS-SEC), median birth intervals, age-specific fertility rates for men and mean age of fathers. All tables are for England and Wales as a whole with no sub-national breakdown.
Childbearing for women born in different years (formerly known as Cohort fertility): presents data on fertility by year of birth of mother rather than the year of birth of child for England and Wales as a whole this package includes the average number of live-born children and the proportion of women remaining childless for women born in different years.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Dataset 2: Hospital Episode Statistics
The initial uses to which ONS will put HES data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users, and will seek to provide frequent updates on these projects during that first stage.
DARS-NIC-175120-W5G2X-v0.10 8 March 2019 to 7 March 2022
- Title
- Office for National Statistics requirements for NHS-Digital data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017
- Commercial
- No
- Sublicensing
- No
- Datasets
- 4
- Files released
- 27
Datasets: Birth Notification Data; Hospital Episode Statistics Accident and Emergency (HES A and E); Hospital Episode Statistics Admitted Patient Care (HES APC); Hospital Episode Statistics Outpatients (HES OP)
Objective for processing
The Office for National Statistics (ONS), as the executive arm of the UK Statistics Authority (UKSA) requires access to administrative data held by NHS Digital, for the production of official statistics.
In the past it has been difficult for ONS to access administrative data controlled by other Government departments, information that could potentially transform official statistics and the impact they have on decision making for the better. Often, this has been caused by the lack of a clear legal basis under which the data can be shared with ONS. As a result, in 2016, ONS set out why legislation was needed for better access to data:
https://www.statisticsauthority.gov.uk/publication/delivering-better-statistics-for-better-decisions-data-access-legislation-march-2016/
As a result, the Digital Economy Act in April 2017 amended the Statistics and Registration Services Act (2007) (SRSA) such that ONS can require public authorities to share data with it. See the Digital Economy Act (chapter 7 of part 5):
http://www.legislation.gov.uk/ukpga/2017/30/part/5/chapter/7/enacted
More specifically, section 45c of the SRSA 2007 (as inserted by section 80 of the Digital Economy Act 2017) permits the Statistics Board (of which ONS is part) to serve a Notice on a public authority requiring it to disclose information it holds in connection with its functions:
http://www.legislation.gov.uk/ukpga/2007/18/section/45C
To do so, the information so disclosed must be required by the Statistics Board for one or more of its functions as set out in the SRSA 2007 and the Census Act 1920.
The SRSA (2007) states that the ONS’s objectives include ‘promoting and safeguarding the production and publication of official statistics that serve the public good, where serving public good includes informing the public about social and economic matters, and assisting in the development and evaluation of public policy’. It also sets out the Board’s functions, which are the specifically referred to in section 45c of the amended SRSA. Notably they include, under section 20, that ONS ‘may produce and publish statistics relating to any matter relating to the United Kingdom or any part of it’.
Requirements made under section 45 must also be in line with a statistical statement of principles that has been approved by parliament:
https://www.gov.uk/government/publications/digital-economy-act-2017-part-5-codes-of-practice/statistics-statement-of-principles-and-code-of-practice-on-changes-to-data-systems
This states that ‘We will only seek access to data for the purposes of fulfilling one or more of our statutory functions, including to produce official statistics and undertake statistical research that meets identifiable user needs for the public good.’
The statement also sets out six principles to which ONS will adhere when requiring information under section 45; they state that ONS will:
• safeguard confidentiality
• be transparent about what data it is accessing and why
• ensure accessing the data is lawful and meet strict ethical standards
• ensure that accessing the data is in the public interest - for example that the data are fit for purpose for the statistical use which ONS intends
• ensure requiring that the data be supplied is proportionate – for example, ONS will have exhausted possible alternatives
• seek to collaborate with suppliers at all times
In addition, the following is a useful framework for categorizing ONS’s statistical uses for information such as that covered under this agreement. They are all ultimately all related to ONS’s functions of producing Official Statistics mentioned earlier:
• Improvements to existing Official Statistics
• Development of new Official Statistics – this may involve testing to investigate whether statistics of sufficient quality can be produced, and may also involve the production of statistics badged as ‘experimental’ while further work is done to improve quality aspects such as accuracy
• Quality assurance of Official Statistics
• Development of commentary around Official Statistics
• Replacement of current survey questions – developing statistics from available data to directly replace the need to collect the information through survey questions
• Improving efficiency or accuracy of sampling – for example, ensuring that a representative sample of the target population is taken when conducting a survey of the public, such that the statistics produced from the survey are the best possible reflection of reality
• Research and development of methodology – for example, using data to develop and test linkage methodology that is ultimately used to help produce statistics based on other data rather than the original data source
Using robust information governance processes, ONS has determined that the conditions associated with requiring data under section 45c of the amended SRSA have been met for the information in this data sharing agreement. This process involved working closely with NHS Digital’s experts to help determine that the data would likely be of good enough quality to meet the proposed statistical purposes. This work guided ONS’s assessment against some of the principles underpinning its legal powers – for example whether sharing the data is in the public interest, and proportionate in terms of burden on the supplier. In addition, as part of its commitment to transparency, ONS will publish full details of the reasons for acquiring the information, and ONS notes that NHS Digital will also publish this data sharing agreement.
In terms of public interest, it is worth noting that the benefits gained from the statistics enabled by this data share do not need to be specific to health and social care when data are flowing under section 45 of the SRSA. For example, some of the data being required will help improve ONS’s population and economic statistics, and in these cases, the improved statistics may not benefit health and social care directly.
The data shared with ONS under this agreement will not be onwardly disseminated or shared, except as disclosure controlled aggregate statistics and/or analysis as aggregated data with small numbers suppressed, in line with the Hospital Episode Statistics Analysis Guide. Any exceptions to this would require additional NHS Digital approval. It would also require an appropriate alternative legal gateway, because section 45c of the SRSA as amended by the Digital Economy Act only enables data to be shared with ONS (not for example, other Government departments or academic researchers).
The rest of this section will set out the specific purposes for which ONS requires each dataset. Each purpose will be linked to the framework of statistical uses set out above.
In future, ONS may decide to put a dataset to new uses not explained below. In these cases, the new use will be in line with ONS’s legally defined functions. ONS will inform NHS Digital and enter into an amended Data Sharing Agreement before proceeding with that new purpose.
Dataset 1: Birth Notifications data
NHS Digital has disseminated birth notifications data to ONS since 2005. Support under section 251 of the NHS Act 2006 (reference PIAG 4-05(d)/2005) permitted this sharing but the legal gateway under which the data will continue to flow will change to section 45c of the amended SRSA 2007.
The birth notifications data contribute to ONS statistical analyses of births, maternities, and infant mortality outcomes. Analyses are made publicly available as aggregate National Statistics. These statistics help a range of public and other bodies make better decisions (see section 5d). They also feed into the Department of Health's NHS Outcomes Framework for monitoring low birthweight of term babies.
Birth registration data that ONS receives from the General Register Office (GRO) is the primary source for producing these statistics, and ONS become controllers of that data under Section 42 of the 2007 Statistics and Registration Services Act. However, there are some limitations with the GRO data, including a lack of medical information such as length of gestation, as well as some missing and implausible values in the fields that are available.
To mitigate these limitations, the NHS Digital birth notifications data are used to improve and validate the registration data. Before this can be done, the two datasets must be linked at an individual level. Several identifying variables such as NHS number are received to enable this linkage.
In terms of the statistical uses framework set out earlier, then the data are used for:
• Improving official statistics – additional information not on the birth registrations data can be added at the record level once the two sources have been linked
• Quality assurance of official statistics – where information is on both sources, the birth notifications data can be used to validate the values contained in the birth registration data, and potentially edit (overwrite) the birth registrations data where that value is missing or implausible
ONS also plans to use birth notifications data to help develop and improve its data linkage methodology. For example, the birth notifications data allows ONS to link siblings born at different times (i.e. not twins) using the NHS number of the mother which is only available on the notification data. This provides a ‘gold standard’ linkage method.
ONS can then then attempt to link siblings together using only the data available in the registration data – e.g. mother’s name and date of birth, but not NHS number. ONS can then assess how closely the latter linkage method matches the gold standard. This will inform the best matching methodology to use when seeking to link siblings if NHS number of mother is not available. This is needed to link pre-2005 birth registration data, a time when the birth notification data is not available to ONS. This purpose would fall under the Research and development of methodology category in the uses framework above.
Dataset 2: Hospital Episode Statistics
There are a range of initial statistical uses to which ONS intends to put Hospital Episodes Statistics (HES) data.
Generally, linkage to other sources at a record level is a prerequisite to success for all proposed uses, and therefore identifiers including postcode, date of birth, sex and NHS number are required. The other HES information required varies by purpose, broken down below.
The specification of the variables being required has been developed in collaboration with NHS Digital data experts to ensure the data being shared are of sufficient quality (e.g. coverage, accuracy, relevance) to be likely to support the statistical purpose intended. The proposed uses of the HES data are as follows.
2.1. To enable ONS’s Administrative Data Census Project, including placing administrative data at the core of migration statistics, using ‘activity’ and characteristics data from HES
ONS’s Administrative Data Census Project (ADC) is assessing whether the Government’s ambition that ‘censuses after 2021 be conducted using other sources of data’ can be realized.
ONS aims to replicate the type of information collected through a census by using administrative data already held by government, supplemented by surveys. This can then be compared with the data collected by the 2021 census itself. This will allow ONS to determine whether this alternative approach can meet users’ needs.
In addition, ONS set out a cross-Government Statistical Service (GSS) programme working with the Home Office (the lead policy department), the devolved administrations and other government departments who have a strong interest in improving the migration evidence base. ONS aims to deliver improvements in migration statistics by putting administrative data at the core of migration statistics as part of the wider transformation to an administrative data-based population statistics system. The programme also recognises the changing demand from users of migration statistics and the need for more information on the impact migrants have while they are in the UK:
https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/internationalmigration/articles/migrationstatisticstransformationupdate/2018-05-24
There are two main types of information from the Hospital Episodes Statistics dataset that are needed for these projects; so called ‘activity data’, and characteristics data.
a. Activity data
ONS has access to administrative sources that include a large proportion of the population such as GP patient registration information and tax records. These provide evidence of how many people live in each area of the country. However, these sources often suffer from over coverage. This is because people may have left the country but still appear in the data, creating the risk that the size of the national population is overestimated. Even when someone is still in the country, they may move without updating their address information with relevant services – for example, they may not register with a new GP at their new location until they need to see a doctor. In this case, there is a risk of ONS including them as contributing to the resident population in the wrong part of the country.
ONS can mitigate these limitations using other sources such as HES. For example, where these other sources show that an individual is interacting with a service, it provides evidence that they are in the country, and indeed which address information is correct (if the main sources mentioned earlier do not agree on this). For this particular use, ONS only requires information about where and when individuals are interacting with hospital services, not why.
b. Characteristics data
Ethnicity and national identity received one of the highest user needs scores from the 2015 census topic consultation, and the census ethnicity information is used by national and local decision makers; for example, in equality impact assessments when local authorities make changes to service delivery. The traditional census includes questions on ethnicity but it is currently very difficult to estimate ethnicity at a local level between censuses. The feasibility of producing admin data based ethnicity estimates will be important when deciding whether to move to an admin data based census after 2021.
Very few administrative sources capture ethnicity at all, so including ethnicity on an administrative data census is challenging. However, HES is one of the few sources where ethnicity is captured. ONS has worked with NHS Digital data experts to understand the limitations of the HES ethnicity data and there are several; for example coverage and differences between the ethnicity categories used on HES vs on the Census. However, there are methodological approaches that can be used to mitigate these, and ONS is of the view that it is in the public interest this ethnicity information is acquired from HES.
In terms of the framework of statistical uses presented earlier in this section, then the Administrative Data Census project work described (both a and b) falls into multiple categories:
• Improvements to existing Official Statistics - If an Administrative Data Census proves feasible, ONS will be able to produce census-type population and other statistics more often, in more granular detail, produce new analyses not possible using traditional census data, and reduce the cost and burden on the public by avoiding a traditional decennial census
• Development of new Official Statistics - In the short term, ‘activity data’ from HES may contribute to new admin data-based migration statistics
• Quality assurance of Official Statistics - ‘Activity data’ will help ONS quality assure presence and address information from other sources
• Development of commentary around Official Statistics - Identification of interaction by migrants with secondary care will allow ONS to expand on and increase the frequency of commentary on population changes and impacts, meeting user demand and providing better evidence to better inform policy-makers; for example, impact of migrants on public service demand
• Research and development of methodology - Estimating ethnicity at a population level by local area using an Administrative Data Census approach will be challenging. Using HES ethnicity data, methodological teams will gain experience of developing methods to mitigate the statistical weaknesses often found in administrative data. For example, how to adjust for bias in coverage, and also data being collected on a different statistical definition compared to the desired definition
2.2. To conduct a range of Statistical Research and Health Analyses using clinical data from HES
ONS’s health analysts will use information about why people have accessed hospital services, for example diagnosis, for a range of statistical purposes.
This information is clearly more sensitive, and the intended statistical uses will require testing to determine whether official statistics of sufficient quality can be produced using HES data. As such, the volume of this information is being minimised to that absolutely necessary to do this. In practice, this means fewer years’ worth of information about why people have accessed hospital services will be shared with ONS, compared with the information about when and where people have accessed services.
a. Exploring the feasibility of producing robust projections of the future health state of the nation.
The State pension age review, 2017, called for more work on healthy life expectancy projections to better inform future decisions about the state pension age. The review also noted their potential value in informing planning future health and social care provision at a local and national level.
These projections would need to take into account population projections, morbidity and mortality trends, and other characteristics, and HES could provide some of the information required. ONS recognises that there are serious limitations when using healthcare activity data, particularly hospital episodes, to make inferences about the health of the population. However, using the HES data experimentally will allow ONS to investigate the possibilities of this dataset contributing to more complete estimation of selected serious and acute illnesses, in combination with mortality data and other relevant sources.
It will be necessary to link the HES data with other data sources to prevent double counting of cases and understand the relative completeness, coverage and quality of each data source, and to enable additional demographic variables to be applied to the HES data, therefore record level identifiable data is required.
In terms of the framework of statistical uses, this would be Research and Development of Methodology in the first instance, with the ultimate goal of Developing New National Statistics.
b. Exploring the use of linked morbidity, mortality, census, benefits and other data to produce more granular statistics on health inequalities and health state life expectancies.
ONS healthy life expectancy statistics are central amongst the public health indicators that help guide decisions by Local Authorities (LAs) about the distribution and prioritisation of services. More local level health expectancy statistics, and more breakdowns such as ethnicity, educational attainment and occupation based socioeconomic position to examine interactions would provide insight allowing LAs to better target interventions to reduce health inequalities.
Researching the feasibility of meeting this need will involve linking the HES data to individuals’ self-assessments of their health and disability status as collected by the 2011 Census, the ONS annual population survey since 2011 (for those surveyed), and ultimately the 2021 Census once collected in due course. ONS will explore the relationship between hospital admissions and self-reported health status at both individual and small area levels, and with reference to potentially mediating or confounding demographic and geographic variables. Therefore, identifiable record level data is required, including postcodes.
Research will include exploring the feasibility of using actual morbidity data such as HES to supplement or even replace survey data to produce healthy life expectancy estimates, potentially allowing more granular statistics.
In terms of the framework of statistical uses, this would be this would be Developing New National Statistics and potentially Replacing current survey questions.
c. Exploring the completeness of death certification and patterns of comorbidities in specific population groups
ONS holds data from the compulsory registration of all deaths in England and Wales. The information recorded about causes of death is sometimes unclear or inadequate for the range of public health, monitoring and research purposes to which the data can be put. The majority of deaths occur in hospital, or following an illness for which the deceased had hospital treatment. Linking the diagnosis data in HES with the registered causes of death will allow exploration of the relationships between them, including:
(i) Understanding multi-morbidity and vulnerability in the elderly. It is well-known that deaths of elderly people tend to mention more health conditions, but also to be less specific in a way which makes identifying the factor(s) which contributed most to death difficult. Terms such as ‘old age’ and ‘frailty’ are often used on death certificates with no specific clinical cause of death. By examining the HES diagnoses and registered causes of death together, ONS will aim to throw more light on the combinations of health conditions in elderly people (multimorbidity), the role and frequency of key conditions such as pneumonia and sepsis in the causal pathways leading to death, and if possible to develop new measures of avoidable mortality in the elderly.
This use would require the linkage of HES to deaths at the individual record level. ONS would also link the data to the Census and/or survey data, so as to explore the role of social factors such as living alone in deaths of the elderly along with clinical factors, with the potential to identify at-risk groups and improve targeting of preventive interventions.
(ii) Understanding infant mortality. The causes of death recorded at registration of perinatal deaths in particular are often very broad and not clinically meaningful. ONS is discussing with clinical and scientific experts ways to improve this information and to determine the underlying cause of death. Linkage of the HES data to registered deaths will provide extra information on the factors underlying the recorded causes of death. ONS will aim to improve the accuracy and completeness of infant mortality statistics, potentially contributing to the government ambition to halve infant mortality by 2025.
In terms of the framework of statistical uses, these projects would contribute to Improvements to existing Official Statistics, Quality Assurance of Official Statistics and Developing New National Statistics.
2.3. improving ONS’ Address Register
This project will investigate using HES data to identify and/or validate the addresses of communal establishments, and would require information including where individuals were admitted from and discharged to. Also:
• Length of stay information will provide evidence of how many people ONS would expect to be classed as usually resident (> 6 months stay) in hospital at any given time
• Sex information may assist with identifying communal establishments that are male or female only.
In terms of the framework of statistical uses, this research, if successful, would enable Quality Assurance of Official Statistics and Improved efficiency / accuracy of sampling.
2.4. Creating a better estimate of the UK household expenditure on hospital services (inpatient only) and medical and paramedical services (outpatient)
The ONS national accounts framework provides a simple and understandable description of national production, income, consumption, accumulation and wealth.
The national accounts research team will investigate whether HES data can improve estimates of revenue paid by patients, split into outpatient and inpatient activity, private patient episodes split by outpatient and inpatient activity, and outpatient activity split between medical services and paramedical services.
The data may also be sued to improve the figures on UK healthcare resources, activity and expenditure which are provided regularly to the international institutions (Eurostat, OECD and WHO) for comparative purposes.
In terms of the framework of statistical uses, the ultimate aim would be to Improve an existing National Statistic – i.e. UK national accounts.
2.5. Enabling the UK to report data or proxy indicator data to measure its progress against the United Nation's Sustainable Development Goals (SDGs)
The UK is committed to reporting progress against all of the internationally agreed Sustainable Development Goals (SDGs), and ONS will lead on delivering this. In some cases, new indicators will need to be developed, and/or new uses made of existing data. Interest in HES is specifically around the feasibility of providing data for the following Sustainable Development indicators:
• Maternal mortality ratio
• Proportion of births attended by skilled health personnel
• Number of people requiring interventions against neglected tropical diseases
• Coverage of treatment interventions (pharmacological, psychosocial and rehabilitation and aftercare services) for substance use disorders
• Proportion of women of reproductive age (aged 15-49 years) who have their need for family planning satisfied with modern methods
• Coverage of essential health services (defined as the average coverage of essential services based on tracer interventions that include reproductive, maternal, newborn and child health, infectious diseases, non-communicable diseases and service capacity and access, among the general and the most disadvantaged population)
ONS’s SDGs team are working with NHS Digital and Public Health England (PHE)to produce these indicators without the need for data sharing. However, ONS also needs to disaggregate these headline indicators by ethnicity, age, sex, disability and geography. In some cases, NHS Digital / PHE will not hold data that would enable this, but linking HES data to ONS held data such as from Census 2011 at an individual level may fill this gap.
In terms of the framework of statistical uses, the ultimate aim would be to Develop a new National Statistic.
Expected output
Dataset 1: Birth Notifications
Official Birth Statistics
Annual birth outputs represent births occurring in England and Wales in a given year. A package containing summary tables for the previous calendar year is released in July, with supporting commentary in a statistical bulletin. More detailed figures are then released between August and December in a series of themed packages. Each package consists of a number of data tables; these are generally accompanied by a statistical bulletin. ONS’ tables provide the latest year’s figures with some also showing historical data for comparison, sometimes back to 1837. ONS publishes all its statistics on its website, and also extends its reach through social media, for example its twitter feed.
There are several published packages:
Birth summary tables: includes the number of live births and stillbirths, fertility rates, percentage of live births outside marriage and civil partnership, mean age of mother and percentage of live births to non-UK born mothers for England and Wales as a whole. Live births (number and rate) and the number of stillbirths are also provided down to local authority level. To aid with user interpretation, ONS also publishes an interactive fertility mapping tool, which enables users to analyse trends in fertility by county district and unitary authority; this is contained within the statistical bulletin.
Parents’ country of birth: includes births by country of birth of mother and total fertility rates for UK born and non-UK born women for England and Wales as a whole. Summary figures are also available down to local authority level. ONS publishes detailed analysis on parents’ country of birth because this information is collected at birth registration and does not change over time, while their nationality or ethnicity may change.
Birth characteristics and by area of usual residence: contains statistics on stillbirths and maternities for England and Wales, birthweight data for live and stillbirths by mother's region of usual residence, and live births and stillbirths in hospitals and communal establishments by region of occurrence. These tables also provide figures on month and quarter of occurrence, place of birth, ethnicity and gestational age and multiple births for England and Wales as a whole. Also provides summary data for live births down to local authority level including figures by age of mother figures are published using boundaries in place during the year the birth occurred.
Births by parents’ characteristics: provides live birth, stillbirth and maternity statistics by age of mother and type of registration (within marriage and civil partnership, joint, sole). It also provides data on previous live-born children, National Statistics Socio-economic Classification (NS-SEC), median birth intervals, age-specific fertility rates for men and mean age of fathers. All tables are for England and Wales as a whole with no sub-national breakdown.
Childbearing for women born in different years (formerly known as Cohort fertility): presents data on fertility by year of birth of mother rather than the year of birth of child for England and Wales as a whole this package includes the average number of live-born children and the proportion of women remaining childless for women born in different years.
Data Linkage Methodology Research: This will result in internal, and potentially external, ONS reports and presentations on how best to link siblings / family units together when linkage based on NHS number is not possible. Any reports or presentations would not include statistics derived from the birth notifications data. They would only include figures comparing the success of various matching strategies compared to one based on linking using mother’s NHS number.
Dataset 2: Hospital Episode Statistics
The initial uses to which ONS will put HES data are most commonly new or improved official statistics that will enable better decision making (see sections 5a and 5d). To reach this goal, a lot of development work, testing, and quality assurance will be required to determine whether official statistics of sufficient quality can be produced in each case.
Generally, this initial work will be disseminated through a range of products and channels, in particular research updates and research outputs. For example, the Admin Data Census project already publishes its research outputs and work involving HES will be reported in similar fashion on this section of the ONS website:
https://www.ons.gov.uk/census/censustransformationprogramme/administrativedatacensusproject/administrativedatacensusresearchoutputs
Subsequently, projects will move on to the production of experimental statistics and potentially in due course, National Statistics (a status that can only be gained once certain quality standards are met). Both types are released via the ONS website.
By way of illustration, a good example of an experimental statistic is here:
https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/articles/estimatingsuicideamonghighereducationstudentsenglandandwalesexperimentalstatistics/2018-06-25
This release is based on a project linking information about suicides with information on higher education students to increase the evidence base on suicides by those in higher education.
No targets can be given as to if and when experimental or National Statistics will be produced using HES data until the initial stage of any given project is complete. All ONS statistical teams engage regularly with users, and will seek to provide frequent updates on these projects during that first stage.
Benefits reported
Yielded Benefits is not a requirement for new applications.
Register history
When this agreement appeared in, or was edited in, each monthly edition of the register. Built by comparing every edition this site holds, the earliest of which is July 2021.
-
July 2021 —
already listed in the earliest edition this site holds, so it may be older. 8 versions: DARS-NIC-175120-W5G2X-v0.10, DARS-NIC-175120-W5G2X-v1.3, DARS-NIC-175120-W5G2X-v2.3, DARS-NIC-175120-W5G2X-v3.3, DARS-NIC-175120-W5G2X-v4.2, DARS-NIC-175120-W5G2X-v5.2, DARS-NIC-175120-W5G2X-v6.4, DARS-NIC-175120-W5G2X-v7.4
-
September 2021
Amended DARS-NIC-175120-W5G2X-v7.4
- Datasets: + HES-ID to MPS-ID HES Accident and Emergency; + HES-ID to MPS-ID HES Admitted Patient Care; + HES-ID to MPS-ID HES Outpatients
-
July 2022
1 version added: DARS-NIC-175120-W5G2X-v8.4
-
August 2022
1 version added: DARS-NIC-175120-W5G2X-v9.2
-
April 2023
1 version added: DARS-NIC-175120-W5G2X-v10.3
-
July 2023
1 version added: DARS-NIC-175120-W5G2X-v11.2
-
November 2023
1 version added: DARS-NIC-175120-W5G2X-v12.2
-
December 2023
1 version added: DARS-NIC-175120-W5G2X-v13.2
-
March 2024
1 version added: DARS-NIC-175120-W5G2X-v14.6Amended DARS-NIC-175120-W5G2X-v13.2
- Datasets: + Improving Access to Psychological Therapies (IAPT) v2
-
February 2025
1 version added: DARS-NIC-175120-W5G2X-v15.4
-
June 2025
1 version added: DARS-NIC-175120-W5G2X-v16.2
-
June 2026
1 version added: DARS-NIC-175120-W5G2X-v17.3
"Amended in place" means NHS England changed the record without issuing a new version number. The register publishes no changelog for those edits; this site infers them by comparing editions. An edit is attributed to the edition it first appears in, not to the date it was made.
Cite this page
NHS England (2026) Data Uses Register, September 2026 edition, agreement DARS-NIC-175120-W5G2X, “D5 - Office for National Statistics requirements for NHS-England (formerly NHS Digital) data, for the purposes of Statistics and Statistical Research, under section 45 of the Statistics and Registration Services Act 2007 as amended by the Digital Economy Act 2017”. Read via NHS Data Access Explorer (unofficial), https://healthdatauses.uk/agreements/dars-nic-175120-w5g2x/ (accessed [date]).
This address stays the same, but the page is rebuilt with each monthly edition, so the citation names the edition it shows. Every edition's data is kept in the facts store.
Source: datausesregister_september2026.xlsx, September 2026 edition of the NHS England Data Uses Register. Search that workbook for DARS-NIC-175120-W5G2X to see the original rows.