Dr Ian Oppermann - Drawing from new digital channels and increased data linkages - FutureData 2017

21
Drawing from new digital channels and increased data linkages Dr. Ian Oppermann NSW Data Analytics Centre 17 th October 2017

Transcript of Dr Ian Oppermann - Drawing from new digital channels and increased data linkages - FutureData 2017

Drawing from new digital channels and increased data linkages

Dr. Ian OppermannNSW Data Analytics Centre

17th October 2017

Look at the world through the lens of

data

CONFIDENTIAL ‐ FOR INTERNAL USE ONLY

2NSW Data Analytics Centre

Data Science is ultimately about productivity

Digitise Link Model Predict Personalise

Understand

Predict“What If”

Evaluate

3NSW Data Analytics Centre

PoC• Proof of Concept• ~3 months• Demonstrate the

concept• May run in off-line

environment

Continuous delivery

MVU• Minimum Viable Use

Case• A partial product

which delivers real value but not yet sufficient for full delivery

• Runs in operational environment

• 6 months from PoC

Continuous delivery

MVP• Minimum Viable

Product• A product which is

delivered and meets multiple use case requirements

• runs in operational environment

Agile development and continuous delivery

4NSW Data Analytics Centre

Making a difference in the real world

5NSW Data Analytics Centre

Community CompositionMachine Learning

7NSW Data Analytics Centre

A Machine Learning ApproachAll in 2011 and 2015, by suburb:• Sydney Water, connections and usage• Number of liquor licenses• AUSGRID connections• Building Sustainability index (BASIX)• Transport incidents and congestion• New ABNs• Births• Land and property information (LPI)

Total Dimensionality of X: 23

8NSW Data Analytics Centre

ResultsPredicted Total Persons Associated uncertainty

Community CompositionTelco Data

10NSW Data Analytics Centre

Areas which peak in daytime hours → COMMERCIAL or INDUSTRIAL

Areas which peak in bedtime hours → RESIDENTIAL

No peak on Friday and following Monday → GOOD FRIDAY / EASTER

RACE MEETINGS in RANDWICK

Step up in population in Randwick since 5 April → WHY?(School Term break: 9-25 Apr ?)

Overview of SA2 Total Pop dataAreas with low pop count

11NSW Data Analytics Centre

12NSW Data Analytics Centre

The project also seeks to develop a better understanding of the cohort of students undertaking courses offered by VET training centres by Region to 

improve projections of skilled graduates in these Regions (“supply” analysis). 

High Level Project Question“What is the alignment

between jobs and skills needed and the VET

courses offered?”

VET Outcomes

13NSW Data Analytics Centre

14NSW Data Analytics Centre

Matching Jobs vs Course offerings - All

A word on privacy 

NSW Data Analytics Centre 16

The Threshold Challenge

NSW Data Analytics Centre

•Cross Jurisdictional

Open data Framework

Governance Framework

Privacy Framework

Practical Data Sharing

Framework

Maturity Framewo

rks

Guidelines and

Recommendations

Advice to Govt and Industry

Common Lexicon

Common Framework for managing Personally Identifiable Information

Contributing to a Data Taskforce

17

18NSW Data Analytics Centre

NSW Data Analytics Centre 19

Practical Data Sharing

NSW Data Analytics Centre 20

Practical Data Sharing

Everything should be made as simple as possible, but no simpler.

Albert Einstein

Dr. Ian OppermannCEO and Chief Data Scientist, NSW Data Analytics Centre

Service and Digital Innovation | Department of Finance, Services & Innovatione [email protected] | www.finance.nsw.gov.auLevel 23, 2‐24 Rawson Place, Sydney NSW 2000