Validation, editing and imputation of the Family Resources Survey

John Snow (DWP)

Family Resources Survey

ESDS Government FRS User Meeting April 2008

Overview of FRS ProcessingONS/NatCen Validation

Editing the data

Imputation

Grossing

Data release

Family Resources Survey

Derived Variables

Validation - Hierarchical Data Structure

Family Resources Survey

Validating the data

• Data Validation – Initial checks (Year start)

Documentation: metadata / One True Version (OTV) Check all new variables Check changes to variables (eg labels) Additional changes (eg routing)

Family Resources Survey

Validating the data

• Data Validation – monthly checks

Record creation General validation

• Set Type checks• Skipped key variables• Skipped important variables

Family Resources Survey

Editing the data 1

• Benefit Editing

Near Zero Amounts Near identical Single / Multiple Benefits Combined Benefits

Family Resources Survey

Editing the data 2

• Pre-imputation editing Outliers – now run by ONS – 6 monthly Credibility Checks – now run by ONS Weekly amounts (Period codes)

• Post-imputation & DVs editing Credibility Checks – run by DWP

Family Resources Survey

Imputation

• What is Imputation? To estimate missing values on item non response

• Why / when do we impute?

• How to impute, and checks? Algorithms Hotdecking Bias

Family Resources Survey

Derived Variables

•What are Derived Variables (DVs)? Customised variables (Note: some created by ONS (eg DVMARDF) Created on data users’ request Used to carry out consistent analysis

Regularly reviewed

Family Resources Survey

Grossing

• What is Grossing?

A factor which is applied to the sample data to give estimates which represent overall population.

Control totals are applied, for males and females by age-band, by region

Other control totals are number of lone parents, tenure type and Council Tax band

Family Resources Survey

Releasing the data

Within DWP: FRS Main Dataset Across analytical directorate

Outside DWP: FRS Anonymised Dataset- Other Government Departments

- Researchers via the UK Data Archive

Family Resources Survey

Terms & Conditions for Using the FRS

• The dataset will be used for secondary analysis in the form of tabulations and statistical modelling

- Outputs will not be produced that are likely to identify an individual

- Regional results should not to be published below Government Office Region (GOR)

• If in doubt please contact the FRS team at DWP (team.frs@dwp.gsi.gov.uk)

Family Resources Survey

Annual FRS Publication

The Annual FRS Publication

• latest ... 2005-06; released on 27 March 2007

• available online

Family Resources Survey

Family Resources Survey

Outside Government

Benefit Take-Up

Households Below Average Income

UK Data Archive

New Policy Institute

Government

DWP

Pensioner Incomes

Policy Simulation

HMT

HMRC

DTI

Scottish Executive

Disability and Carers

WWEG, PCD…

Pensions Commission

Defra

DfES

Europe : LIS

Institute of Fiscal Studies

The FRS Community

Northern Ireland, DSD

Family Resources Survey

Family Poverty & Work

ONS

For further help…IFD IM1

Phone Maxine Willitts (Team Leader: General, Data Release, report) (020) 7962

8092 Jeremy Barton (Harmonisation, Methodology, Analysis) (020) 7962

8991 John Snow (Imputation, Derived Variables) (020) 7962

8946 Robert Chung (Benefit Editing, Data Access) (020) 7962

8731

Any questions?

Family Resources Survey