Big Data Activitiesat Eurostat

Workshop on Statistical Data Collection, 29 Apr – 1 May 2015, Washington D.C, USA

Albrecht.Wirthmann@ec.eurostat.eu

Eurostat

Big Data at Eurostat

• European Statistical System (ESS)• Scheveningen Memorandum Sep 2013• ESS Task Force Big Data• Big Data Roadmap and Action Plan 1.0 June 2014• ESS BIGD project

ESS Pilots 2016 - 2019

Eurostat

Activities at Eurostat

• Within EurostatPilots exploring• mobile phone data for tourism and population

statistics• Flight reservation systems for transport statistics• Wikipedia page Google search data for nowcasting

unemployment

Eurostat

Within ESS: The BIGD project• What?

• Implement ESS Big Data Action Plan

• Why?• Enable the ESS to gradually integrate big data sources into the

production of European and national statistics

• How?• Concrete Big Data Pilots

Mobile phone data, websites, …

• In parallel work on horizontal issues

• Three time ranges in roadmap• Short term 2015-2016

Analysis of legislation, Strategy, Ethics, Communication

• Medium term 2016-2020Pilots, Partnerships, IT Architecture, Skills

• Long term >2020Full integration into official statistics

Eurostat

Big Data Pilots

Communication

Mobile phone data

Social Media

WWW

Web Searches

Businesses'Websites

eCommerce Websites

Job Adver-tisements

Real Estate Websites

Internet Traffic

Sensors

Traffic Loops

Smart Meters

Vessel Identification

Satellite Images

Webcams

Process generated

Flight Reservation

Systems

Supermarket Cashier Data

Loyalty Programs

Financial Transactions

eGovernment

Mobile Payments

Crowd Sourcing

VGI websites (Open

Streetmap)

Community Pictures

Collections

Big Data Pilots 2016 - 2019

Eurostat

The statistical office of the future

• Data flows in addition to / instead of surveys and censuses• Stat. products designer in addition to data collection designer

• Statistical modelling will be a main activity• From descriptive indicators to nowcasting (and forecasting)

• New answers related to• Quality and transparency• Privacy and confidentiality• Access to third party data sources / data sharing• Scientific standards and methodology• Professional ethics• Skills

• Trust and Quality is key!• New role in teaching digital numeracy• Accreditation and certification instead of production• Embedded in data flow – statistics 'everywhere'

Eurostat

Thank you for your Attention!