NHS Digital Data Processing ServicesTransforming the way we work with data to

improve health and careNHS-HE, 16 January 2020

Graham Spearing

Product Manager

Automated

capabilities

Streamlined, faster

processes

Reduced duplication

of tasks

Freeing up resources

for value-added work

Reduced burden

Responsive to

customers

Efficient Effective Economical Compliant

Better access to data

Better quality / linked

data

More timely data

Enabling innovative

uses of data

Wider product and

service offering

Stronger partnerships

Rationalisation of

systems and

infrastructure

Improved security

and transparency

Standardised de-

identification

capability

Reduced need for

data to leave NHS

Digital

Delivering

world class

data and

analytics

Optimising

value for

money

Trusted safe

haven for

health and

care data

Enabling our Data Services transformation…

2

Faster access to data that is…

More timely TransparentHigh qualityBetter-linkedSecure

whilst benefitting from…

DARS integration – simplifying governance

Interrogation and analysis tools – more functionality

‘Bring Your Own Data’ capability – greater utility

Providing our customers with…

3

4

PROTECT

OurPeople

PracticeTo

Data

KnowledgeTo

Practice

DataTo

Knowledge

Collect-------------

Data Standards

Analyse & Interpret-------------------------

Assemble-------------

Change-------------

Partnership Working

Access-------------

Content and Architecture

Access to Patient-Level

Open Data & PublicationsPurposeful Analytics

Secure Data Platform

Secure Data PlatformSecure Data Platform

0

50

100

150

200

250

Improving data

capabilities

Improving

health and

care

Supporting

assessments

and efficiencies

Supporting

policy and

planning

Supporting

research

activities

References to category of impacthttps://digital.nhs.uk/data-and-information/data-insights-and-statistics/dars-clinical-reviewData Standards

• Increased uptake of key standards• Expert national coding bureaus• Natural Language Processing

framework

• Reduce burden• Interoperability

Enhancing the Learning Health System

• Richer• Higher Quality• Faster• More accessible• Less burdensome

Content and Architecture

• New collections• Frontline event based• Longitudinal Record• Richer• Reduce duplication and burden

Secure Data Platform

• Rationalise• Automate• Optimise• Better tools• Improved security• Improved governance

Purposeful Analytics

• Do the basics well• Enable advanced analytics• Thought leadership• Collaboration

Access to patient level data

• Trust & Transparency• More data• Broader range of customers• Faster• Optimise application and delivery• Harmonise• Help

Open data and publications

• Standardise open data & dashboards• Understand customer requirements• More sophisticated publications• Multisource data• Improved website and chat bot• Data Hubs

The Learning

Health System Cycle

University of Oxford, Million Women Study The largest study of its kind in the world carrying out research on the cohort for over 20 yearsMain focus is on the effects of hormone replacement therapy, but the large cohort enables the study of a very broad range of health issues Study findings have influenced national policy, including recommendations on the prescribing and use of hormone replacement therapy

Imperial College London, Small Area Health Statistics UnitInternationally recognised research into environmental health Assesses the risk to the health of the population from environmental factors at a small area scaleWork includes substantive epidemiological enquiries of environmental health problems and methodological researchStudies have produced over 200 peer reviewed publications

University of Bristol, Children of the 90s/Avon Longitudinal study of parents and childrenWorld leading birth cohort study, charting the health of 14,500 families in the Bristol areaProvides a uniquely rich resource for studying environmental and genetic factors that affect a person’s health and development. Over 1,500 academic papers published

Our data supports…

5

DPS is now live, including…

Secure, internet-facing data collection portal: to collect data from providers and provide

data quality feedback

Strategic master person service: to improve the quality of person matching and facilitate

improved data linkage

Modern, cloud-based data access environment: to provide secure, remote access to data

held by NHS Digital

Modern, cloud-based data processing platform: to standardise the processing of data

collected by NHS Digital

Strategic de-identification/re-identification solution: to provide consistent de-

identification and controlled linkage and re-identification of data, for use in the DPS and

across the NHS

6

We’re investing in a modern data platform (“DPS”)…

DPS portal

Data processing,

master person

and de-id/re-id

services

Data access

environment

DPS

Data AcquisitionData

Optimisation

Insights & Statistics

Data Access

NHS Digital Data, Insights & Statistics

Collect Process Utilise

Delivering modern data processing services to significantly enhance our ability to increase the

security, reduce the cost and increase the efficiency of our data services; and, ultimately, to deliver

faster and higher quality information and insights to customers to improve health and care

7

How you access the data - Data Access Environment

8

Data Access Tools

9

SQL

Currently

Later this year

Protecting people’s data…

10

Blue Alberta Skies

11

Dec 19 Jan 20 Feb March April - June Later

DPS PORTAL

TECH

DPSCORE

TECHNICAL

DATA ONBOARDIN

G

DM Toolkit

KeycloakSeparation

OTHERCORE

Development RoadmapData Processing Service

DPSDAE

TECH

DATA

GP DATA

IAPT

CSDS

SUS+ CDS - OP, APC, A&E, ECDS, HES

MHSDS multiple submissions

CDS DQ Dashboards

Primary Care Meds

BYOD Discovery BYOD – Cohort Data

DIS Analyst access improvements

DARS integration

USEREXP

CSDS & IAPT

Patient Opt Outs Applied

Seeing other submissions within Org

Password self reset Test submissions

R Studio

Ambulance

ADMIN

USEREXP

BYOD reference data/other non ID data

PersonalisedUser Interface

CDA systemReporting on access permissions

Simplified DAE home page

Collaboration spacesAll years views

Deletion from S3 bucket

HUE in databricks

Extract of all active users

MHSDS Year-To-Date

Internal Monitoring

External Monitoring

Data Collection Management

DSCRO Extract improvements

Data Visualisation

DPS Data DQ Dashboards

Data retrieval via SDCS Cloud Sophisticated notification system

Monitor system access via notifications

Daily corporate reference data

Ingest XML files Shared DM code library

Ingest JSON lines files

Pseudonymised views Empower DMs to support more file

formats

Ingest CSV filesAbility to De-ID

Schedule notebook execution

Add Person ID via MPS

CSV output

Data collection error handling

Output to SEFT folder

Support DIS Data Onboarding Plan – supporting use cases as a priority

Enhancements based on user feedback

Enhancements based on user feedback

Maternity Updates

MPSaaS - NHSD Integrate Patient Objection Service

CRM and Data Minimisation

Intense build phase with lots of priorities

13

Example datasets to be loaded onto DPS

• Historic HES Data

• Mental Health

• Maternity

• GP Appointments

• Primary Care Medicines

• Secondary Care Medicines

• IAPT

• Community

• PROMS

• DIDS

14

• 111 Pathways

• SUS+ Hospital CDS & HES

• Emergency Care Dataset

• ONS Births & Deaths

• PLICS – Acute, Amb, IAPT, MH

• Aggregate datasets

• More… NHS Digital data to be

onboarded onto DPS over the next 2

years

• Other sources of data…

Programme status

• DPS platform developed “in-house” over last 18 months and all components

are now live

• Focus in 2019/20:

• Enhance the services in line with the agreed product roadmap

• Optimise the onboarding of data

• Improve data access from request to customer delivery

• Transition the services to business-as-usual operations and close the

programme (by Mar-20, as per FBC)

15

Thank you for listening

Our website: https://digital.nhs.uk/data-and-information/data-insights-

and-statistics/improving-our-data-processing-services

My email: gs@nhs.net

16

Connect with us

@nhsdigital

company/nhs-digital

www.digital.nhs.uk

17