Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money
-
Upload
corinium-coriniumglobal -
Category
Data & Analytics
-
view
234 -
download
1
Transcript of Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money
![Page 1: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/1.jpg)
Driving Innovationwith DataCDAO Sydney6-8 March 2017
Blair Hudson (@blairhudson)Innovation Portfolio Manager – Data SciencePepper Group Limited
![Page 2: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/2.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
2
Pepper Group – diverse global financial services
AustraliaMortgage lendingAuto and equipment financePersonal loansThird party servicingProperty advisory
South KoreaMortgage lendingAuto and equipment financePersonal loansDeposits
United KingdomMortgage lendingThird party servicingProperty advisory
IrelandMortgage lendingThird party servicingProperty advisory
SpainPoint of sale financeThird party servicing
![Page 3: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/3.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
3
OpportunityOpportunity InitiativeInitiative ConceptConcept PrototypePrototype PilotPilot LaunchProduction
Innovation is part of our DNA
In 2016 we defined our process to support company-wide innovation,and structured key strategic portfolios including Data Science
![Page 4: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/4.jpg)
4
Copyright 2017 Pepper. Confidential.
How would you like to use machine learning today?
![Page 5: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/5.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
5
Reality is more like
OpportunityOpportunity Launch
Like design, the art of data science can be begin uncertain,but unravels with focus on a single outcome
Production
Reality is more like Damien Newman’s squiggle
![Page 6: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/6.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
6
So how do we turn this…
OpportunityOpportunity LaunchProduction
(Damien Newman’s squiggle)
![Page 7: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/7.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
7
…into this?
OpportunityOpportunity InitiativeInitiative ConceptConcept PrototypePrototype PilotPilot LaunchProduction
(Awesome value-driven process for Data Science innovation)
![Page 8: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/8.jpg)
8
Copyright 2017 Pepper. Confidential.
1. Opportunity
![Page 9: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/9.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
9
Tools for discovery and understanding
Opportunity Canvas Value Sequence
![Page 10: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/10.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
10
Value Sequence
Tools for discovery and understanding
Opportunity Canvas
![Page 11: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/11.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
11
Opportunity Canvas
Work Activities
Risks
RiskMitigators
Returns
ReturnAccelerators
BusinessFunction
Core / Support
Adjacent Functions
![Page 12: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/12.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
12
Opportunity Canvas
Work Activities
Risks
RiskMitigators
Returns
ReturnAccelerators
BusinessFunction
Core / Support
Adjacent Functions
![Page 13: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/13.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
13
Value SequenceSequence Sequence
Track
Track
Track
Track
![Page 14: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/14.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
14
Value SequenceSequence Sequence
Track
Track
Track
Track
![Page 15: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/15.jpg)
15
Copyright 2017 Pepper. Confidential.
2. Initiatives
![Page 16: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/16.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
16
Initiative SorterInitiative Scorecard
Tools for planning your roadmap
![Page 17: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/17.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
17
Initiative SorterInitiative Scorecard
Tools for planning your roadmap
![Page 18: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/18.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
18
DVF criteria
Feasibility
ViabilityDesirability
Is this a valid data science opportunity?Does supporting data exist already?
How long could it take?What are the expected benefits?
Is this a strategic priority?Is the use case easily understood?
![Page 19: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/19.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
19
Opportunity
Initiative Scorecard
Sequence
Function
TrackAccelerator / Mitigator
Total Score
FeasibilityDesirability Viability
Revenue / Risk Measure
Work Activity
![Page 20: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/20.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
20
Opportunity
Initiative Scorecard
Sequence
Function
TrackAccelerator / Mitigator
Total Score
FeasibilityDesirability Viability
Revenue / Risk Measure
Work Activity
![Page 21: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/21.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
21
Initiative Sorter15 14 13 12 11 10 9 8 7 6 5 4 3
Horizon 1
Horizon 2
Horizon 3
Ready Now
Needs DataF < 4
Needs TechnologyV < 4
Needs OwnerD < 4
![Page 22: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/22.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
22
Initiative Sorter15 14 13 12 11 10 9 8 7 6 5 4 3
Horizon 1
Horizon 2
Horizon 3
Ready Now
Needs DataF < 4
Needs TechnologyV < 4
Needs OwnerD < 4
![Page 23: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/23.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
23
15 14 13 12 11 10 9 8 7 6 5 4 3
Horizon 1
Horizon 2
Horizon 3
Initiative Sorter
Ready Now
Needs DataF < 4
Needs TechnologyV < 4
Needs OwnerD < 4
![Page 24: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/24.jpg)
24
Copyright 2017 Pepper. Confidential.
3. Concept
![Page 25: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/25.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
25
Thinking ahead…
Prototype ProductionPilot
Validation(Offline)
AB Test(Online)
![Page 26: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/26.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
26
Experiment Plan
Tools for conceptual (experiment) design
![Page 27: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/27.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
27
Experiment Plan
Tools for conceptual (experiment) design
![Page 28: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/28.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
28
Experiment PlanObservation
Sequence
Target
Hypothesis Test
Control
AcceptanceModel
![Page 29: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/29.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
29
Experiment PlanObservation
Sequence
Target
Hypothesis Test
Control
AcceptanceModel
![Page 30: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/30.jpg)
30
Copyright 2017 Pepper. Confidential.
4. Prototype
![Page 31: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/31.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
31
Tools for rapid prototyping
(This isn’t so easily summarised into simple graphical tools…)
![Page 32: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/32.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
32
Our ethos drives sustainability
Avoid technical debt at all costs
Be relentlesslyvalue driven
Walk first, then run!
![Page 33: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/33.jpg)
33
Copyright 2017 Pepper. Confidential.
5. Pilot
![Page 34: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/34.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
34
Pre-conditions for pilot
Before pilot (AB test), the prototype must be validated on unseen historical data,otherwise continue prototyping (or reformulate concept hypotheses)
Modelling (80%) Validation (20%)
Historical data
![Page 35: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/35.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
35
AB testing
Determine
minimum sample
for A and B
Apply model on B group
and action
Observe results in A and B
until minimums reached
Analyse results
for significa
nce
![Page 36: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/36.jpg)
36
Copyright 2017 Pepper. Confidential.
6. Production
![Page 37: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/37.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
37
Pre-conditions for production
Before launch, the AB test must reach statistical significance, otherwise keep piloting (or reformulate concept hypotheses)
https://xkcd.com/1478/
![Page 38: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/38.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
38
Three types of consumption
Model summaries
Batchscoring
Real-time scoring
![Page 39: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/39.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
39
If you’ve made it this far…
Domain Expertise
Computer
Science
Mathematics and Statistics
Change and
Strategy
You’ve joined the dots betweenfour key fields!
![Page 40: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/40.jpg)
Blair Hudson (@blairhudson) Copyright 2017 Pepper. Confidential.
40
Thank you
@blairhudson
linkedin.com/in/blairhudson
Blair Hudson
![Page 41: Blair Hudson, Innovation Portfolio Manager for Data Science, Pepper Money](https://reader035.fdocuments.in/reader035/viewer/2022070517/58d1094c1a28ab823e8b569b/html5/thumbnails/41.jpg)
Pepper Group Limited ABN 55 094 317 665. Australian Finance Services Licence 286655; Australian Credit Licence 286655 Pepper Asset Finance Pty Ltd CAN 165 183 317; Australian Credit Licence 458899 © Copyright 2016 Pepper Group Limited. All
rights reserved.
Copyright 2017 Pepper. Confidential.